-- Logs begin at Fri 2022-10-14 17:15:39 UTC, end at Fri 2022-10-14 18:13:18 UTC. -- Oct 14 17:46:21.078330 dv-cinder-749155-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 14 17:46:21.087079 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 14 17:46:21.089094 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 17:46:21 2022] *** Oct 14 17:46:21.089094 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 17:46:21.089094 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 17:46:21.089094 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: nodename: dv-cinder-749155-15-iscsi Oct 14 17:46:21.089094 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: machine: x86_64 Oct 14 17:46:21.089094 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: clock source: unix Oct 14 17:46:21.089094 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: pcre jit disabled Oct 14 17:46:21.089094 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: detected number of CPU cores: 4 Oct 14 17:46:21.089094 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: current working directory: / Oct 14 17:46:21.089094 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: detected binary path: /usr/bin/uwsgi-core Oct 14 17:46:21.089784 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: your processes number limit is 47680 Oct 14 17:46:21.089784 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: your memory page size is 4096 bytes Oct 14 17:46:21.089784 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: detected max file descriptor number: 2048 Oct 14 17:46:21.089784 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: lock engine: pthread robust mutexes Oct 14 17:46:21.089784 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: thunder lock: enabled Oct 14 17:46:21.089784 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 14 17:46:21.089784 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 17:46:21.128515 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: Python main interpreter initialized at 0x5583d5dc29c0 Oct 14 17:46:21.128515 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: python threads support enabled Oct 14 17:46:21.128515 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: your server socket listen backlog is limited to 100 connections Oct 14 17:46:21.128515 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: your mercy for graceful operations on workers is 90 seconds Oct 14 17:46:21.128879 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 17:46:21.128962 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: *** Operational MODE: preforking *** Oct 14 17:46:21.129175 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: *** uWSGI is running in multiple interpreter mode *** Oct 14 17:46:21.129175 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: spawned uWSGI master process (pid: 103622) Oct 14 17:46:21.129360 dv-cinder-749155-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 14 17:46:21.130291 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: spawned uWSGI worker 1 (pid: 103623, cores: 1) Oct 14 17:46:21.130291 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: spawned uWSGI worker 2 (pid: 103624, cores: 1) Oct 14 17:46:21.130552 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 17:46:21.794962 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 17:46:21.795691 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 17:46:22.881782 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:46:22.881782 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: from cryptography.utils import int_from_bytes Oct 14 17:46:22.882385 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:46:22.882385 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: from cryptography.utils import int_from_bytes Oct 14 17:46:22.882528 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:46:22.882528 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: from cryptography.utils import int_from_bytes Oct 14 17:46:22.882528 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:46:22.882528 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: from cryptography.utils import int_from_bytes Oct 14 17:46:25.390053 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 17:46:25.390595 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 17:46:25.390844 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 17:46:25.391205 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 17:46:25.391458 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 17:46:25.391843 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.392081 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 17:46:25.392444 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.392541 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 17:46:25.392631 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.392795 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.392898 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 17:46:25.393120 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.393210 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 17:46:25.393427 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.393521 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 17:46:25.393744 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.393831 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.394059 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.394145 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.394382 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.394478 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.394640 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.394727 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.394952 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.395044 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.395270 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-15-iscsi {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.395364 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.395600 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.395739 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.395902 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.395993 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.396217 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.396305 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.396470 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.396556 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.396781 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.396867 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.397099 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-15-iscsi {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.397195 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.397408 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.397508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.397708 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.397901 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.398014 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.399036 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.399209 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.399341 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.399433 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.399524 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.399693 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.399781 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.399861 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.399861 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.400089 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.400202 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.400286 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.400627 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.400717 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.400805 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.400942 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.401027 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.401170 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.401325 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.401460 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.401684 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.401771 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-15-iscsi {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.402002 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.402149 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.402302 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.402400 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.402618 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.402712 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.402921 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.403008 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.403309 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-15-iscsi {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.403403 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.403613 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.403698 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.403935 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.404088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.404245 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.404343 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.404624 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.404949 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.405170 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.405372 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.405489 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.405695 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.405843 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.406017 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.406112 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.406319 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.406407 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.406628 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.406724 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.406938 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.407071 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.407257 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.407344 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.407562 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.407651 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.407869 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.407998 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.408141 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.408235 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.408446 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.408534 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.408767 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.408864 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.409092 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.409188 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.409390 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.409489 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.409644 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.409731 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.409893 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.410000 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.410208 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.410296 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.410521 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.410606 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.410823 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.410918 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.411130 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.411217 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.411373 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.411460 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.411618 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.411707 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.411952 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.412061 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.412270 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.412362 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.412575 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.412671 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.412876 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.412963 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.413176 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.413262 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.413476 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.413565 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.413775 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.413862 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.414076 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.414244 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.414376 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.414463 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.414675 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.414787 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.414985 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.415081 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.415293 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.415382 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.415606 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.415692 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.415968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.416078 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.416280 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.416393 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.416597 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.416791 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.416915 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.417040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.417222 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.417344 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.417528 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.417675 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.417834 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.417978 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.418156 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.418294 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.418480 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.418569 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.418788 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.418884 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.419038 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.419165 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.419337 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.419467 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.419640 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.419767 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.419979 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.420670 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.420830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.421208 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.421467 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.421554 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.421782 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.421869 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.422038 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.422126 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.422341 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.422429 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.422653 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.422740 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.422973 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.423068 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.423276 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.423362 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.423579 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.423664 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.423896 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.424001 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.424202 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.424288 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.424505 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.424600 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.424805 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.424900 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.425109 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.425196 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.425411 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.425506 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.425714 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.425812 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.426015 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.426102 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.426313 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.426398 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.426614 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.426708 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.426916 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.427002 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.427214 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.427300 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.427518 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.427623 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.427832 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.427964 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.428160 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.428259 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.428460 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.428551 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.428763 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.428851 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.429064 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.429152 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.429367 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.429462 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.429669 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.429757 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.429970 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.430057 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.430274 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.430369 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.430573 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.430666 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.430873 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.430960 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.431173 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.431266 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.431472 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.431559 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.431771 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.431869 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.432096 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.432184 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.432395 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.432490 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.432692 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.432779 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.432992 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.433087 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.433288 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.433375 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.433586 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.433680 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.433885 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.433972 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.434183 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.434272 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.434481 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.434577 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.434780 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.434865 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.435074 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.435160 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.435371 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.435468 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.435681 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.436354 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.436669 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.436986 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.437093 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.437321 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.437418 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.437652 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.437740 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.437973 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.438069 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.438286 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.438375 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.438601 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.438688 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:46:25.438932 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.439033 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.439243 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.439337 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.439553 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.439641 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.439864 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.439987 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.440205 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.440300 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.440522 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.440610 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.440850 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.440938 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.441159 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.441245 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.441471 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.441557 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.441788 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.441893 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.442093 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.442187 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.442403 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.442499 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.442711 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.442812 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.443031 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.443117 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.443340 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.443427 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.443665 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.443752 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.444006 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.444099 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.444322 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.444411 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.444638 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.444733 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.444947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.445035 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.445258 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.445346 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.445568 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.445656 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.445878 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.445967 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.446183 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.446271 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.446517 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.446604 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.446829 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.446927 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.447149 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.447245 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.447461 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.447548 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.447777 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.447864 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.448111 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.448211 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.448420 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.448508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.448727 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.448812 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.449038 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.449136 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.449348 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.449435 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.449656 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.449741 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.449972 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.450142 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.450282 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.450377 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.450593 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.450680 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.450898 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.450986 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.451204 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.451302 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.451549 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.451858 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.451987 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.452190 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.452305 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.452495 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.452617 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.452799 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.452952 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.453102 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.453273 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.453409 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.453593 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.453712 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.453906 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.454031 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.454217 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.454356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.454533 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.454661 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.454841 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.454992 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.455150 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.455297 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.455456 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.455608 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.455757 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.455935 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.456083 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.456246 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.456383 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.456550 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.456677 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.456860 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.456975 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.457170 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.457291 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.457475 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.457615 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.457797 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.457916 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.458107 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.458241 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.458418 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.458554 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.458743 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.458835 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.459046 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.459149 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.459353 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.459442 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.459667 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.459754 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.460000 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.460106 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.460310 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.460397 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.460611 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.460698 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.460917 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.461013 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.461224 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.461331 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.461526 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.461620 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.461832 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.461934 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.462133 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.462231 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.462431 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.462519 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.462742 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.462889 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.463053 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.463193 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.463360 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.463499 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.463669 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.463807 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.463996 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.464128 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.464306 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.464444 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.464595 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.464733 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.464896 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.465032 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.465198 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.465422 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.465558 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.465643 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.465791 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.465879 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.466092 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.466188 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.466394 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.466482 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.466694 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.466833 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.467033 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.467165 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.467355 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.467663 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.467800 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.467994 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.468136 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.468301 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.468444 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.468603 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.468751 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.468949 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.469144 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.469241 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.469453 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.469575 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.469756 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.469905 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.470058 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.470220 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.470357 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.470537 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.470656 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.470847 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.470973 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.471157 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.471278 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.471465 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.471577 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.471771 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.471868 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.472105 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.472242 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.472415 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.472503 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.472732 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.472828 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.473042 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.473187 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.473359 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.473496 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.473668 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.473805 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.473988 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.474140 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.474297 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.474434 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.474613 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.474757 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.474899 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.475041 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.475207 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.475352 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.475499 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.475640 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.475800 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.475958 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.476140 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.476287 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.476431 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.476566 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.476746 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.476906 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.477039 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.477184 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.477354 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.477505 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.477642 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.477776 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.477955 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.478106 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.478244 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.478379 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.478548 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.478681 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.478864 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.479012 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.479180 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.479318 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.479487 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.479623 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.479799 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.480011 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.480149 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.480283 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.480419 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.480552 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.480715 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.480861 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.481019 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.481156 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.481324 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.481462 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.481629 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.481763 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.481942 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.482079 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.482245 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.482380 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.483088 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.483242 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.483418 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.483732 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.483955 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.484050 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.484286 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.484376 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.484596 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.484684 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.484912 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.484999 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.485213 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.485302 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.485524 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.485612 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.485828 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.485928 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.486134 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.486229 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.486446 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.486543 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.486750 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.486845 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.487049 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.487186 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.487350 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.487483 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.487652 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.487794 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.487981 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.488115 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.488281 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.488418 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.488566 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.488671 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.488869 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.489002 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.489175 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.489313 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.489477 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.489615 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.489780 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.489917 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.490078 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.490210 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.490379 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.490525 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.490681 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.490817 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.490977 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.491124 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.491267 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.491403 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.491563 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.491700 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.491899 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.492037 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.492192 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.492336 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.492495 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.492629 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.492797 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.492944 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.493080 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.493221 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.493381 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.493513 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.493694 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.493838 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.493996 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.494128 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.494292 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.494435 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.494572 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.494786 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.494925 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.495058 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.495194 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.495329 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.495466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.495613 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.495750 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.495911 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.496080 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.496222 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.496398 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.496535 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.496701 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.496837 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.497007 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.497150 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.497308 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.497397 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.497611 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.497700 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.497923 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.498011 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.498381 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.498589 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.498957 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.499160 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.499250 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.499473 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.499570 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.499784 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.499938 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.500118 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.500216 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.500426 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.500541 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.500745 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.500873 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.501049 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.501190 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.501354 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.501502 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.501661 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.501815 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.501960 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.502122 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.502263 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.502427 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.502577 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.502739 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.503043 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.503129 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.503359 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.503457 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.503651 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.503748 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.503986 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.504104 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.504291 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.504442 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.504595 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.504759 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.504900 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.505089 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.505205 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.505414 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.505511 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.505725 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.505814 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.506031 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.506118 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.506336 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.506433 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.506639 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.506726 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.506938 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.507031 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.507246 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.507401 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.507546 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.507694 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.507831 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.508009 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.508156 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.508292 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.508433 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.508567 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.508716 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.508851 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.508997 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.509145 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.509292 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.509488 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.509589 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.509795 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.509892 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.510100 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.510199 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.510421 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.510509 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.510725 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.510815 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.511028 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.511116 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.511328 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.511415 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.511624 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.511711 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.511942 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.512034 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.512243 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.512341 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.512552 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.512684 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.512860 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.512949 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.513165 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.513253 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.513471 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.513568 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.514288 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.514387 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.514710 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.515004 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.515188 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.515321 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.515501 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.515629 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.515825 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.515955 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.516155 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.516243 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.516459 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.516547 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.516761 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.516862 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.517070 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.517158 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.517376 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.517515 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.517676 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.517823 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.517982 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.518120 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.518287 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.518422 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.518589 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.518727 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.518891 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.518981 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.519190 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.519335 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.519549 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.519687 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.519822 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.519982 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.520114 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.520252 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.520398 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.520533 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.520667 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.520800 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.520934 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.521089 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.521233 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.521369 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.521510 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.521645 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.521810 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.521971 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.522104 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.522242 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.522378 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.522520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.522687 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.522831 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.522979 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.523115 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.523251 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.523388 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.523550 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.523703 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.523857 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.524030 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.524166 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.524299 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.524464 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.524614 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.524779 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.524926 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.525084 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.525221 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.525617 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.525750 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.525922 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.526059 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.526222 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.526357 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.526504 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.526641 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.526803 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.526938 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.527107 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.527251 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.527410 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.527529 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.527709 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.527801 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.528027 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.528135 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.528332 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.528438 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.528630 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.528730 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.528924 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.529022 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.529221 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.529319 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.529702 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.530076 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.530165 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.530395 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.530492 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.530698 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.530787 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.530998 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.531086 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.531297 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.531394 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.531595 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.531683 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.531931 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.532035 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.532240 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.532336 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.532537 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.532624 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.532838 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.532993 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.533144 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.533292 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.533428 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.533561 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.533741 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.533891 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.534058 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.534203 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.534380 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.534517 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.534682 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.534829 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.534987 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.535126 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.535293 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.535428 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.535596 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.535743 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.535920 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.536058 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.536202 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.536338 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.536507 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.536657 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.536800 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.536935 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.537102 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.537257 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.537405 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.537552 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.537685 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.537828 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.537963 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.538098 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.538272 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.538410 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.538577 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.538715 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.538879 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.539025 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.539190 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.539332 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.539491 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.539629 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.539788 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.539971 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.540115 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.540258 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.540394 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.540527 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.540691 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.540837 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.540986 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.541120 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.541285 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.541421 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.541590 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.541740 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.541895 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.542050 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.542183 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.542320 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.542489 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.542639 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.542780 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.542925 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.543078 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.543215 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.543383 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.543545 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.543691 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.543834 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.544002 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.544198 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.544349 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.544512 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.544649 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.544823 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.544972 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.545180 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.545325 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.545676 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.545985 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.546127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.546296 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.546440 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.546604 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.546747 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.546912 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.547047 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.547216 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.547354 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.547521 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.547656 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.547842 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.547963 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.548173 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.548336 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.548494 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.548584 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.548816 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.548909 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.549127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.549223 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.549429 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.549566 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.549840 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.549977 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.550150 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.550316 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.550456 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.550545 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.550762 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.550850 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.551064 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.551163 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.551364 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.551452 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.551667 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.551763 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.552007 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.552114 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.552311 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.552409 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.552609 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.552697 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.552906 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.552995 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.553221 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.553318 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.553520 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.553607 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.553823 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.553918 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.554145 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.554234 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.554464 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.554551 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.554776 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.554870 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.555097 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.555185 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.555494 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.555579 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.555800 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.555933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.556141 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.556242 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.556457 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.556545 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.556774 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.556871 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.557076 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.557163 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.557379 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.557466 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.557684 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.557779 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.557985 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.558072 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.558288 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.558377 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.558592 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.558754 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.558897 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.558994 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.559192 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.559279 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.559500 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.559599 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.559807 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.559922 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.560141 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.560236 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.560443 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.560531 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.561274 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.561578 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.561833 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.561922 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.562164 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.562261 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.562476 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.562565 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.562796 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.562884 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.563097 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.563232 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.563406 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.563493 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.563708 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.564034 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.564124 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.564334 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.564420 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.564634 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.564731 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.564949 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.565036 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.565249 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.565337 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.565554 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.565651 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.565861 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.565949 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.566165 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.566253 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.566462 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.566563 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.566761 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.566857 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.567077 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.567173 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.567378 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.567475 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.567695 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.567836 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.568026 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.568129 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.568342 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.568432 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.568655 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.568741 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.568953 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.569039 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.569260 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.569348 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.569561 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.569647 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.569858 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.569957 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.570161 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.570248 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.570469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.570564 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.570772 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.570898 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.571077 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.571192 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.571382 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.571469 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.571704 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.571804 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.572040 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.572131 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.572362 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.572451 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.572672 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.572769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.572975 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.573063 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.573279 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.573366 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.573581 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.573679 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.573893 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.573979 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.574212 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.574356 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.574495 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.574637 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.574775 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.574911 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.575080 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.575218 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.575382 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.575520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.575678 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.575816 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.575987 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.576126 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.576296 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.576454 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.576724 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.577044 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.577191 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.577356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.577505 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.577665 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.577810 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.577981 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.578073 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.578286 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.578383 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.578601 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.578689 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.578906 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.579122 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.579220 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.579458 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.579546 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.579776 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.579864 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.580123 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.580224 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.580436 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.580523 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.580749 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.580835 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.581052 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.581152 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.581366 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.581454 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.581675 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.581769 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.581983 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.582072 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.582293 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.582379 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.582605 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.582696 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.582918 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.583007 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.583229 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.583318 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.583538 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.583633 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.583848 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.584028 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.584182 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.584269 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.584492 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.584587 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.584807 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.584896 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.585159 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.585319 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.585475 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.585644 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.585784 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.585957 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.586100 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.586267 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.586414 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.586583 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.586729 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.586883 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.587041 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.587192 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.587351 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.587500 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.587664 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.587806 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.588013 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.588138 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.588327 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.588430 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.588636 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.588752 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.588952 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.589068 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.589267 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.589387 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.589590 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.589716 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.589930 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.590026 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.590250 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.590338 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.590563 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.590658 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.590879 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.590995 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.591194 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.591289 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.591543 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.591711 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.591846 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.592666 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.593116 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.593209 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.593466 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.593555 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.593785 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.593917 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.594100 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.594187 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.594419 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.594565 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.594725 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.594869 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.595031 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.595170 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.595336 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.595472 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.595644 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.595781 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.595978 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.596123 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.596287 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.596438 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.596594 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.596730 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.596908 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.597044 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.597215 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.597313 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.597524 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.597618 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.597830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.597925 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.598140 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.598361 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.598654 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.598742 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.598967 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.599055 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.599337 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.599442 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.599613 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.599703 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.599950 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.600044 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.600263 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.600360 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.600574 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.600662 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.600879 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.600966 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.601184 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.601273 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.601480 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.601567 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.601784 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.601879 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.602087 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.602181 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.602384 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.602518 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.602691 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.602778 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.602993 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.603088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.603290 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.603379 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.603597 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.603692 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.603916 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.604007 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.604247 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.604451 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.604550 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.604793 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.604884 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.605107 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.605202 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.605422 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.605509 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.605727 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.605816 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.606028 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.606117 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.606326 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.606425 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.606626 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.606719 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.606931 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.607024 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.607231 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.607326 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.607562 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.607676 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.608105 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.608427 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.608517 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.608752 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.608840 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.609058 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.609183 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.609369 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.609461 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.609679 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.609775 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.609982 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.610071 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.610286 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.610382 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.610583 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.610670 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.610907 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.610993 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.611205 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.611301 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.611506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.611602 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.611807 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.611918 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.612153 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.612255 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.612455 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.612544 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.612754 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.612998 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.613093 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.613331 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.613420 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.613635 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.613723 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.613935 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.614022 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.614244 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.614334 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.614543 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.614631 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.614847 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.614945 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.615160 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.615247 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.615483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.615572 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.615779 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.615923 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.616117 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.616205 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.616420 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.616506 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.616721 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.616826 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.617028 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.617122 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.617333 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.617420 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.617639 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.617727 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.617943 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.618030 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.618249 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.618336 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.618558 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.618650 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.618866 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.618954 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.619172 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.619398 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.619505 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.619730 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.619822 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.620097 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.620194 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.620440 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.620539 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.620757 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.620846 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.621070 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.621157 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.621373 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.621462 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.621676 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.621766 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.621981 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.622068 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.622288 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.622386 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.622594 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.622681 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.622897 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.622985 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.623711 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.623845 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.624064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.624459 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.624547 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.624766 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.624855 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.625087 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.625401 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.625487 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.625713 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.625810 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.626023 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.626112 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.626333 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.626422 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.626642 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.626738 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.626948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.627035 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.627255 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.627343 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.627566 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.627654 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.627902 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.627995 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.628224 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.628311 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.628536 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.628675 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.628848 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.628937 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.629160 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.629249 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.629465 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.629555 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.629770 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.629857 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.630071 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.630166 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.630372 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.630458 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.630677 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.630764 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.630998 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.631094 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.631304 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.631391 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.631603 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.631690 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.631919 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.632234 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.632322 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.632538 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.632626 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.632840 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.632928 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.633143 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.633232 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.633443 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.633531 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.633750 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.633845 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.634051 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.634148 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.634352 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.634440 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.634654 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.634760 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.634955 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.635043 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.635257 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.635345 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.635560 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.635658 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.635866 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.635981 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.636190 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.636278 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.636495 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.636585 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.636796 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.636891 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.637097 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.637185 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.637399 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.637492 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.637715 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.637803 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.638019 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.638107 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.638318 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.638407 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.638616 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.638707 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.639014 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.639131 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.639451 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.639766 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.639856 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.640116 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.640219 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.640437 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.640527 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.640751 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.640839 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.641059 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.641145 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.641359 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.641447 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.641662 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.641750 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.641965 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.642054 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.642266 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.642356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.642568 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.642656 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.642869 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.642966 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.643176 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.643264 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.643476 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.643569 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.643777 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.643920 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.644103 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.644194 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.644405 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.644494 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.644713 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.644814 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.645040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.645130 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.645353 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.645447 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.645664 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.645761 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.645979 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.646068 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.646285 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.646372 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.646595 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.646684 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.646897 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.646991 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.647202 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.647289 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.647510 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.647599 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.647816 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.647922 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.648146 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.648236 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.648455 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.648545 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.648768 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.648865 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.649075 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.649174 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.649384 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.649472 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.649689 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.649788 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.649992 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.650096 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.650296 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.650674 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.650869 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.650965 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.651189 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.651291 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.651490 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.651587 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.651807 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.651945 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.652145 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.652246 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.652461 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.652549 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.652768 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.652855 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.653073 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.653162 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.653315 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 17:46:25.653404 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.653683 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.653989 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.654299 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.655609 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.655949 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.656272 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.656586 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.656898 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.657214 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.657531 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.657854 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.658177 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.658484 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.658806 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.659126 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.659467 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.659779 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.660143 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.660468 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.660781 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.661089 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.661391 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:46:25.661630 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 17:46:25.806486 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO dbcounter [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Registered counter for database nova_api Oct 14 17:46:25.819739 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO dbcounter [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Registered counter for database nova_api Oct 14 17:46:25.828520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_db.sqlalchemy.engines [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:46:25.834975 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writer thread running {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:46:25.840004 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG oslo_db.sqlalchemy.engines [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:46:25.847545 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writer thread running {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:46:25.892475 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.context [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3910e64-6c9f-4b06-9301-0c1a6426780a(cell1) {{(pid=103623) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 17:46:25.896300 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:46:25.896778 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:46:25.898337 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:46:25.899063 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:46:25.899510 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:46:25.901781 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:46:25.903753 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO dbcounter [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Registered counter for database nova_cell0 Oct 14 17:46:25.906132 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.context [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3910e64-6c9f-4b06-9301-0c1a6426780a(cell1) {{(pid=103624) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 17:46:25.908741 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO dbcounter [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Registered counter for database nova_cell1 Oct 14 17:46:25.909980 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG oslo_concurrency.lockutils [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:46:25.910449 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG oslo_concurrency.lockutils [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:46:25.912292 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG oslo_concurrency.lockutils [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:46:25.913022 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG oslo_concurrency.lockutils [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:46:25.913461 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG oslo_concurrency.lockutils [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:46:25.915478 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG oslo_concurrency.lockutils [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:46:25.915980 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_db.sqlalchemy.engines [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:46:25.917561 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO dbcounter [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Registered counter for database nova_cell0 Oct 14 17:46:25.917676 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_db.sqlalchemy.engines [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:46:25.922887 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO dbcounter [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Registered counter for database nova_cell1 Oct 14 17:46:25.924294 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writer thread running {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:46:25.926505 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writer thread running {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:46:25.931928 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG oslo_db.sqlalchemy.engines [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:46:25.933632 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG oslo_db.sqlalchemy.engines [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:46:25.940417 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writer thread running {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:46:25.941871 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writer thread running {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:46:26.070482 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO dbcounter [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Registered counter for database nova_cell0 Oct 14 17:46:26.079954 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_db.sqlalchemy.engines [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:46:26.084671 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writer thread running {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:46:26.088900 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO dbcounter [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Registered counter for database nova_cell0 Oct 14 17:46:26.097013 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG oslo_db.sqlalchemy.engines [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:46:26.101420 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writer thread running {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:46:26.421380 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: WARNING keystonemiddleware.auth_token [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 17:46:26.428647 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: WARNING keystonemiddleware.auth_token [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 17:46:26.429522 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: WARNING keystonemiddleware.auth_token [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 17:46:26.437918 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: WARNING keystonemiddleware.auth_token [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 17:46:26.769380 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: WARNING keystonemiddleware.auth_token [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 17:46:26.775250 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: WARNING keystonemiddleware.auth_token [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 17:46:26.780856 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5583d5dc29c0 pid: 103623 (default app) Oct 14 17:46:26.782912 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:46:26.784107 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001707 Oct 14 17:46:26.784520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Fri Oct 14 17:46:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:46:26.789144 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: WARNING keystonemiddleware.auth_token [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 17:46:26.795639 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: WARNING keystonemiddleware.auth_token [None req-b92b234c-4cbe-454c-96fd-d05c43e7bf46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 17:46:26.801498 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5583d5dc29c0 pid: 103624 (default app) Oct 14 17:47:47.635855 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:47:47.637611 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Oct 14 17:47:47.638336 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:47:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:47:47.651287 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_api:SELECT=3 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:47.652433 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_cell1:SELECT=3 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:47.653140 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_cell0:SELECT=3 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:47.654338 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_cell0:SELECT=3 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:48.558560 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-9a37f57b-5ba5-4317-8592-391e8cdda6f9 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:47:48.591051 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-9a37f57b-5ba5-4317-8592-391e8cdda6f9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.945157 Oct 14 17:47:48.591916 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Oct 14 17:47:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:47:51.265503 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:47:51.266186 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-d447408e-814a-4d69-9416-db2cbc01a93b None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Oct 14 17:47:51.266571 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:47:51.722686 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-e964eca3-b95c-450b-800d-c6529c316714 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:47:51.770938 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-e964eca3-b95c-450b-800d-c6529c316714 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497758 Oct 14 17:47:51.771731 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Oct 14 17:47:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:47:51.786110 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_api:SELECT=3 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:51.788347 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_cell0:SELECT=3 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:51.790312 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_cell1:SELECT=3 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:51.791063 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:52.009519 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-e989bd47-68ad-43c0-bd39-0d1f6b03722d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:47:52.082240 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-e989bd47-68ad-43c0-bd39-0d1f6b03722d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.301940 Oct 14 17:47:52.083182 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Oct 14 17:47:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:47:54.797508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-e964eca3-b95c-450b-800d-c6529c316714 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:47:54.798536 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-e964eca3-b95c-450b-800d-c6529c316714 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 14 17:47:54.798925 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:47:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 17:47:55.447054 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-65fa74ae-4711-4344-8e9e-3f07c47b640d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:47:55.486733 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-65fa74ae-4711-4344-8e9e-3f07c47b640d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.681315 Oct 14 17:47:55.487478 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Oct 14 17:47:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 17:47:55.499731 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-d74745b1-4e42-45c7-98c4-009e250036ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:47:55.541741 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-d74745b1-4e42-45c7-98c4-009e250036ed admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045766 Oct 14 17:47:55.542331 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Oct 14 17:47:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:47:58.165441 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-65fa74ae-4711-4344-8e9e-3f07c47b640d admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:47:58.166473 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-65fa74ae-4711-4344-8e9e-3f07c47b640d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 14 17:47:58.166881 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:47:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:47:58.582515 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-6cdec2dd-a01a-4669-a8ab-11897c0b8a9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:47:58.602982 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-6cdec2dd-a01a-4669-a8ab-11897c0b8a9a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429479 Oct 14 17:47:58.603635 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Oct 14 17:47:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 17:47:58.616455 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-3cd003a2-0fa1-410e-af0a-c436f56e8988 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:47:58.645377 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-3cd003a2-0fa1-410e-af0a-c436f56e8988 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032675 Oct 14 17:47:58.645959 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Oct 14 17:47:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:48:01.317850 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-6cdec2dd-a01a-4669-a8ab-11897c0b8a9a admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:01.318864 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-6cdec2dd-a01a-4669-a8ab-11897c0b8a9a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 14 17:48:01.319274 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:48:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:01.738319 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-1ea657bf-033b-48ff-ab4f-3c3fb1711937 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "vcpus": 2, "swap": 0}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:01.760126 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-1ea657bf-033b-48ff-ab4f-3c3fb1711937 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434233 Oct 14 17:48:01.760688 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Oct 14 17:48:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:01.773042 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-8c8a6878-946c-4bc9-85fe-6ab72120073b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:01.802316 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-8c8a6878-946c-4bc9-85fe-6ab72120073b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032991 Oct 14 17:48:01.802945 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Oct 14 17:48:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:48:04.477883 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-1ea657bf-033b-48ff-ab4f-3c3fb1711937 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:04.478857 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-1ea657bf-033b-48ff-ab4f-3c3fb1711937 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 14 17:48:04.479294 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:48:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:04.958220 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-508d0593-5353-4e4c-801b-209b774153be admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "name": "ds4G", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:04.980768 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-508d0593-5353-4e4c-801b-209b774153be admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495240 Oct 14 17:48:04.983955 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Oct 14 17:48:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:04.993779 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-d82a945a-f1d1-435f-9abb-619bf47f11f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:05.020298 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-d82a945a-f1d1-435f-9abb-619bf47f11f3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030055 Oct 14 17:48:05.020979 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Fri Oct 14 17:48:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:48:07.673246 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-508d0593-5353-4e4c-801b-209b774153be admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:07.674258 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-508d0593-5353-4e4c-801b-209b774153be admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 14 17:48:07.674656 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:48:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:08.103084 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-dbe5b65b-75cc-4385-bc56-66ad5c740d75 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:08.134840 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-dbe5b65b-75cc-4385-bc56-66ad5c740d75 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452142 Oct 14 17:48:08.135471 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Oct 14 17:48:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:48:10.840490 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-508d0593-5353-4e4c-801b-209b774153be admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:10.841517 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-508d0593-5353-4e4c-801b-209b774153be admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 14 17:48:10.841957 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:11.258823 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-b1151d67-3f5b-448f-a6c9-8febbbd8aa82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "name": "m1.tiny", "disk": 1, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:11.280381 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-b1151d67-3f5b-448f-a6c9-8febbbd8aa82 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.431425 Oct 14 17:48:11.280862 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Oct 14 17:48:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:11.294218 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-a7fac69c-ca0e-44c6-915e-12c2920c04a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:11.322481 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-a7fac69c-ca0e-44c6-915e-12c2920c04a2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031987 Oct 14 17:48:11.323057 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Oct 14 17:48:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:48:13.977611 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-b1151d67-3f5b-448f-a6c9-8febbbd8aa82 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:13.978626 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-b1151d67-3f5b-448f-a6c9-8febbbd8aa82 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 14 17:48:13.979018 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:48:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:14.385529 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-4e7becd1-0e58-4402-a19b-5b7fd58fbb3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "ram": 2048, "id": "2"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:14.406459 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-4e7becd1-0e58-4402-a19b-5b7fd58fbb3b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421210 Oct 14 17:48:14.407041 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Oct 14 17:48:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:14.419450 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-c506c9b1-339c-4448-90fa-c7f74c302812 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:14.443113 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-c506c9b1-339c-4448-90fa-c7f74c302812 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027270 Oct 14 17:48:14.443676 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Oct 14 17:48:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:48:17.044366 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-4e7becd1-0e58-4402-a19b-5b7fd58fbb3b admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:17.045378 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-4e7becd1-0e58-4402-a19b-5b7fd58fbb3b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 14 17:48:17.045832 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:48:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:17.417573 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-01916f80-852e-4ad5-a14c-7f2db385a396 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "id": "3", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:17.438313 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-01916f80-852e-4ad5-a14c-7f2db385a396 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.385555 Oct 14 17:48:17.439036 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Oct 14 17:48:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:17.451358 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-af6c970d-4604-422d-aed6-5fe50fd07ec6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:17.475439 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-af6c970d-4604-422d-aed6-5fe50fd07ec6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027778 Oct 14 17:48:17.476045 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Oct 14 17:48:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:48:20.131760 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-01916f80-852e-4ad5-a14c-7f2db385a396 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:20.132823 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-01916f80-852e-4ad5-a14c-7f2db385a396 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 14 17:48:20.133224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:20.607330 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-6eec77d0-fb68-4c58-9436-12615fe27b01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "vcpus": 4, "ram": 8192, "swap": 0}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:20.613146 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:20.629624 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-6eec77d0-fb68-4c58-9436-12615fe27b01 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.489665 Oct 14 17:48:20.631926 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Oct 14 17:48:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:20.642213 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-5c838fb0-b476-418e-8287-068d428ea426 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:20.669854 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-5c838fb0-b476-418e-8287-068d428ea426 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031270 Oct 14 17:48:20.671926 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Oct 14 17:48:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:48:23.287121 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-6eec77d0-fb68-4c58-9436-12615fe27b01 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:23.288907 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-6eec77d0-fb68-4c58-9436-12615fe27b01 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002311 Oct 14 17:48:23.289463 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:48:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:23.865015 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-a19ce7bf-dc86-4437-8581-a404eb4b3c5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:23.871803 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:23.887962 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-a19ce7bf-dc86-4437-8581-a404eb4b3c5a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.591687 Oct 14 17:48:23.888729 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Fri Oct 14 17:48:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:23.901648 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-1c2e045c-7488-44b6-b197-cb774431f116 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:23.930846 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-1c2e045c-7488-44b6-b197-cb774431f116 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033522 Oct 14 17:48:23.931642 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Fri Oct 14 17:48:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:48:44.369076 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-a19ce7bf-dc86-4437-8581-a404eb4b3c5a admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:44.370090 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-a19ce7bf-dc86-4437-8581-a404eb4b3c5a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 14 17:48:44.370498 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:44.380935 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:44.755745 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-97e0a5ca-0a13-41aa-991a-c1749a54465f admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:44.773985 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-97e0a5ca-0a13-41aa-991a-c1749a54465f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397516 Oct 14 17:48:44.774511 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Oct 14 17:48:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:48:46.079898 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-a19ce7bf-dc86-4437-8581-a404eb4b3c5a admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:46.080916 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-a19ce7bf-dc86-4437-8581-a404eb4b3c5a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 14 17:48:46.081326 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:46.608773 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-d81a788e-d164-47a1-8bbb-6d1dc2b4d402 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:46.614091 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.wsgi [None req-d81a788e-d164-47a1-8bbb-6d1dc2b4d402 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-d81a788e-d164-47a1-8bbb-6d1dc2b4d402 admin admin] Request method failure captured: Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Accept: application/json Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Accept-Encoding: gzip, deflate Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Connection: keep-alive Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Content-Length: 0 Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Host: 10.222.0.27 Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Openstack-Api-Version: compute 2.92 Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Openstack-System-Scope: None Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: User-Agent: python-novaclient Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Auth-Token: gAAAAABjSaD92IGus9szbpOPEItltnUq0ywhmo-bMG2PF3D4LvdPcE_sKBwFWKL9aNZZo8K3bhO1rYX_lc7Dm4DEIzaP2kDUPKte6gEVgvYFod_zstV4tuw-f-oqjbrQhX0s7yxFfUvVMk9E8sWUDgmbQ9ZriFeNY4nR3H06RmAT55N7h8OFaFU Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Domain-Id: None Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Domain-Name: None Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Identity-Status: Confirmed Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Is-Admin-Project: True Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Domain-Id: default Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Domain-Name: Default Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Name: admin Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Role: member,reader,admin Oct 14 17:48:46.617506 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Roles: member,reader,admin Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a41cbe9ae3574988a4c391824f7f340a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Tenant: admin Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Tenant-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Tenant-Name: admin Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User: admin Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Domain-Id: default Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Domain-Name: Default Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Id: 92acc9f005ce4ccfaadbc688dbb479a3 Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Name: admin Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: method: > Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: exception: Flavor 42 could not be found. Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: action_args: {'id': '42'} Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:48:46.619127 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:46.620178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:46.621508 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-d81a788e-d164-47a1-8bbb-6d1dc2b4d402 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:48:46.622748 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-d81a788e-d164-47a1-8bbb-6d1dc2b4d402 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396576 Oct 14 17:48:46.622748 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Oct 14 17:48:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:46.629374 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-7912fe39-62a6-4858-9c4e-47d0b191f814 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:46.652212 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-7912fe39-62a6-4858-9c4e-47d0b191f814 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027054 Oct 14 17:48:46.652767 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Oct 14 17:48:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:48:46.664075 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-f54692f5-72d8-4c3b-a10b-f22eb57ab89b admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:46.685966 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-f54692f5-72d8-4c3b-a10b-f22eb57ab89b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027041 Oct 14 17:48:46.686491 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Oct 14 17:48:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:48:46.696530 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-3bf3c5b0-aae9-4d41-95aa-3e83b325a173 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:46.701707 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.wsgi [None req-3bf3c5b0-aae9-4d41-95aa-3e83b325a173 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-3bf3c5b0-aae9-4d41-95aa-3e83b325a173 admin admin] Request method failure captured: Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Accept: application/json Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Accept-Encoding: gzip, deflate Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Connection: keep-alive Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Content-Length: 0 Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Host: 10.222.0.27 Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Openstack-Api-Version: compute 2.92 Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Openstack-System-Scope: None Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: User-Agent: python-novaclient Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Auth-Token: gAAAAABjSaD92IGus9szbpOPEItltnUq0ywhmo-bMG2PF3D4LvdPcE_sKBwFWKL9aNZZo8K3bhO1rYX_lc7Dm4DEIzaP2kDUPKte6gEVgvYFod_zstV4tuw-f-oqjbrQhX0s7yxFfUvVMk9E8sWUDgmbQ9ZriFeNY4nR3H06RmAT55N7h8OFaFU Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Domain-Id: None Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Domain-Name: None Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Identity-Status: Confirmed Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Is-Admin-Project: True Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Domain-Id: default Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Domain-Name: Default Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Name: admin Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Role: member,reader,admin Oct 14 17:48:46.704933 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Roles: member,reader,admin Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a41cbe9ae3574988a4c391824f7f340a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Tenant: admin Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Tenant-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Tenant-Name: admin Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User: admin Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Domain-Id: default Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Domain-Name: Default Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Id: 92acc9f005ce4ccfaadbc688dbb479a3 Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Name: admin Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: method: > Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: exception: Flavor 42 could not be found. Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: action_args: {'id': '42'} Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:48:46.706520 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:46.707483 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:46.709830 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-3bf3c5b0-aae9-4d41-95aa-3e83b325a173 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:48:46.711046 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-3bf3c5b0-aae9-4d41-95aa-3e83b325a173 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014103 Oct 14 17:48:46.711046 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Oct 14 17:48:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:47.928912 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-f54692f5-72d8-4c3b-a10b-f22eb57ab89b admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:47.929943 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-f54692f5-72d8-4c3b-a10b-f22eb57ab89b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 14 17:48:47.930344 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:48.463121 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-98ad29cb-17d4-488f-90ab-7fa707e879f4 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:48.468259 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.wsgi [None req-98ad29cb-17d4-488f-90ab-7fa707e879f4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-98ad29cb-17d4-488f-90ab-7fa707e879f4 admin admin] Request method failure captured: Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Accept: application/json Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Accept-Encoding: gzip, deflate Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Connection: keep-alive Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Content-Length: 0 Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Host: 10.222.0.27 Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Openstack-Api-Version: compute 2.92 Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Openstack-System-Scope: None Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: User-Agent: python-novaclient Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Auth-Token: gAAAAABjSaD_atKSo86wkI31n7DDkh-y4hWlcvpOfK2lQ1LFgo07rKxt8t7bcES95C7OoYQF4IY9ehK_WiaXBjdzW5atfXm3rs2VNq6v1U9in0yQJcYFh-EKX0X4kTcFaxpzn5nT8thLFV7IoUj5PL_1u5abpdYzL7SHZ-27KL9j2_JGdvQZYkE Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Domain-Id: None Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Domain-Name: None Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Identity-Status: Confirmed Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Is-Admin-Project: True Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Domain-Id: default Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Domain-Name: Default Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Name: admin Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Role: member,reader,admin Oct 14 17:48:48.469761 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Roles: member,reader,admin Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a41cbe9ae3574988a4c391824f7f340a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Tenant: admin Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Tenant-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Tenant-Name: admin Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User: admin Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Domain-Id: default Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Domain-Name: Default Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Id: 92acc9f005ce4ccfaadbc688dbb479a3 Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Name: admin Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: method: > Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: exception: Flavor 84 could not be found. Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: action_args: {'id': '84'} Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:48:48.471329 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:48.473356 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:48.475224 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-98ad29cb-17d4-488f-90ab-7fa707e879f4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:48:48.476277 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-98ad29cb-17d4-488f-90ab-7fa707e879f4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394198 Oct 14 17:48:48.476277 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Oct 14 17:48:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:48.481547 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-eb693aef-b344-4600-b97c-e719f7040853 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:48.496706 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-eb693aef-b344-4600-b97c-e719f7040853 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018746 Oct 14 17:48:48.497230 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Oct 14 17:48:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:48:48.508154 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-94524002-d7b1-4645-a223-ff075f79caed admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:48.524479 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-94524002-d7b1-4645-a223-ff075f79caed admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020467 Oct 14 17:48:48.524988 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Oct 14 17:48:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:48:48.534082 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-5546ccef-9f42-410e-a9f0-ebfb65755e29 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:48.539905 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.wsgi [None req-5546ccef-9f42-410e-a9f0-ebfb65755e29 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-5546ccef-9f42-410e-a9f0-ebfb65755e29 admin admin] Request method failure captured: Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Accept: application/json Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Accept-Encoding: gzip, deflate Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Connection: keep-alive Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Content-Length: 0 Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Host: 10.222.0.27 Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Openstack-Api-Version: compute 2.92 Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Openstack-System-Scope: None Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: User-Agent: python-novaclient Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Auth-Token: gAAAAABjSaD_atKSo86wkI31n7DDkh-y4hWlcvpOfK2lQ1LFgo07rKxt8t7bcES95C7OoYQF4IY9ehK_WiaXBjdzW5atfXm3rs2VNq6v1U9in0yQJcYFh-EKX0X4kTcFaxpzn5nT8thLFV7IoUj5PL_1u5abpdYzL7SHZ-27KL9j2_JGdvQZYkE Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Domain-Id: None Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Domain-Name: None Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Identity-Status: Confirmed Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Is-Admin-Project: True Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Domain-Id: default Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Domain-Name: Default Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Name: admin Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Role: member,reader,admin Oct 14 17:48:48.541466 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Roles: member,reader,admin Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a41cbe9ae3574988a4c391824f7f340a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Tenant: admin Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Tenant-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Tenant-Name: admin Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User: admin Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Domain-Id: default Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Domain-Name: Default Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Id: 92acc9f005ce4ccfaadbc688dbb479a3 Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Name: admin Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: method: > Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: exception: Flavor 84 could not be found. Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: action_args: {'id': '84'} Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:48:48.542948 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:48.543910 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:48.544947 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-5546ccef-9f42-410e-a9f0-ebfb65755e29 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:48:48.545996 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-5546ccef-9f42-410e-a9f0-ebfb65755e29 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012239 Oct 14 17:48:48.545996 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Fri Oct 14 17:48:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:49.760706 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-94524002-d7b1-4645-a223-ff075f79caed admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:49.761716 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-94524002-d7b1-4645-a223-ff075f79caed admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 14 17:48:49.762107 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:50.284789 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-6dc089ef-3cf3-4300-a948-372056d044ae admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:50.291647 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.wsgi [None req-6dc089ef-3cf3-4300-a948-372056d044ae admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-6dc089ef-3cf3-4300-a948-372056d044ae admin admin] Request method failure captured: Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Accept: application/json Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Accept-Encoding: gzip, deflate Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Connection: keep-alive Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Content-Length: 0 Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Host: 10.222.0.27 Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Openstack-Api-Version: compute 2.92 Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Openstack-System-Scope: None Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: User-Agent: python-novaclient Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Auth-Token: gAAAAABjSaEB0Qc_TJ-mDcqTeWgBUuKHKUetE6oRU6dnGiKsT09upFg1QeeWb2jTiX4RdSp-IwpfAEh_O5HH-biSbfG30U-CLInPFMJ0VqjoW_SnPPPlB9xhU2dBaqUOVc8MlHh2FPncuP9e6hfgmQxVp0reiNnyr9L7gAjsBAe0YOKPpOH-Y4w Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Domain-Id: None Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Domain-Name: None Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Identity-Status: Confirmed Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Is-Admin-Project: True Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Domain-Id: default Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Domain-Name: Default Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Project-Name: admin Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Role: member,reader,admin Oct 14 17:48:50.293265 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Roles: member,reader,admin Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a41cbe9ae3574988a4c391824f7f340a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Tenant: admin Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Tenant-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-Tenant-Name: admin Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User: admin Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Domain-Id: default Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Domain-Name: Default Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Id: 92acc9f005ce4ccfaadbc688dbb479a3 Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: X-User-Name: admin Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: method: > Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: exception: Flavor 451 could not be found. Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: action_args: {'id': '451'} Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:48:50.294769 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:50.295723 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Oct 14 17:48:50.297040 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-6dc089ef-3cf3-4300-a948-372056d044ae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:48:50.298267 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-6dc089ef-3cf3-4300-a948-372056d044ae admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.396224 Oct 14 17:48:50.298267 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Oct 14 17:48:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:50.304432 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-f020f22e-cd1e-4a60-a808-532746a818e8 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:50.320061 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-f020f22e-cd1e-4a60-a808-532746a818e8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019122 Oct 14 17:48:50.320599 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Oct 14 17:48:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:48:50.330231 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:50.345527 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018869 Oct 14 17:48:50.346053 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Fri Oct 14 17:48:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:48:50.357401 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-7f889c0a-61aa-42aa-9fc0-bbaa6659066c admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:50.362441 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.wsgi [None req-7f889c0a-61aa-42aa-9fc0-bbaa6659066c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-7f889c0a-61aa-42aa-9fc0-bbaa6659066c admin admin] Request method failure captured: Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Accept: application/json Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Accept-Encoding: gzip, deflate Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Connection: keep-alive Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Content-Length: 0 Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Host: 10.222.0.27 Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Openstack-Api-Version: compute 2.92 Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Openstack-System-Scope: None Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: User-Agent: python-novaclient Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Auth-Token: gAAAAABjSaEB0Qc_TJ-mDcqTeWgBUuKHKUetE6oRU6dnGiKsT09upFg1QeeWb2jTiX4RdSp-IwpfAEh_O5HH-biSbfG30U-CLInPFMJ0VqjoW_SnPPPlB9xhU2dBaqUOVc8MlHh2FPncuP9e6hfgmQxVp0reiNnyr9L7gAjsBAe0YOKPpOH-Y4w Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Domain-Id: None Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Domain-Name: None Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Identity-Status: Confirmed Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Is-Admin-Project: True Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Domain-Id: default Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Domain-Name: Default Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Project-Name: admin Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Role: member,reader,admin Oct 14 17:48:50.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Roles: member,reader,admin Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a41cbe9ae3574988a4c391824f7f340a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a41cbe9ae3574988a4c391824f7f340a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Tenant: admin Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Tenant-Id: a41cbe9ae3574988a4c391824f7f340a Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-Tenant-Name: admin Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User: admin Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Domain-Id: default Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Domain-Name: Default Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Id: 92acc9f005ce4ccfaadbc688dbb479a3 Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: X-User-Name: admin Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: method: > Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: exception: Flavor 451 could not be found. Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: action_args: {'id': '451'} Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:48:50.366064 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:50.367088 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Oct 14 17:48:50.368469 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-7f889c0a-61aa-42aa-9fc0-bbaa6659066c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:48:50.369725 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-7f889c0a-61aa-42aa-9fc0-bbaa6659066c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012075 Oct 14 17:48:50.369725 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Oct 14 17:48:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 14 17:48:51.577241 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:51.578254 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 14 17:48:51.578653 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:48:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:52.099730 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-72f8b51c-8eb5-45f3-847c-c489fff5b99b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:52.118515 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-72f8b51c-8eb5-45f3-847c-c489fff5b99b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.401692 Oct 14 17:48:52.119056 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Oct 14 17:48:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:53.343014 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:53.344060 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 14 17:48:53.344460 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:48:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:53.863385 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-e48d5e01-299d-4979-b584-83c64bdd9781 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:53.883410 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-e48d5e01-299d-4979-b584-83c64bdd9781 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.397904 Oct 14 17:48:53.883986 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Oct 14 17:48:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:55.113296 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:55.114349 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 14 17:48:55.115203 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:48:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:55.637395 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-47321fd5-e514-49db-9cfb-2ca8bfbf9c88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:55.656909 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-47321fd5-e514-49db-9cfb-2ca8bfbf9c88 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.405196 Oct 14 17:48:55.657451 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Oct 14 17:48:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:56.875442 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:56.876512 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 14 17:48:56.876938 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:48:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:48:57.398431 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-1fdd688d-d2e0-4936-b3de-9fc0f850f49b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:48:57.417944 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-1fdd688d-d2e0-4936-b3de-9fc0f850f49b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.401803 Oct 14 17:48:57.418519 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Fri Oct 14 17:48:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:48:58.637348 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:58.638362 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 14 17:48:58.638760 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:48:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 17:48:59.165109 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-ceb74b86-142a-489d-8cb5-f39ff8114a51 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:48:59.185936 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-ceb74b86-142a-489d-8cb5-f39ff8114a51 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.409681 Oct 14 17:48:59.186406 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Fri Oct 14 17:48:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:49:56.670889 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:49:56.671981 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fb8bc732-3a87-419f-a5e3-82b3b9b6cf20 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 14 17:49:56.672385 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Fri Oct 14 17:49:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:49:56.682751 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:57.065880 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-e8f7f179-1f96-4147-b393-02902818968b admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:49:57.087149 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-e8f7f179-1f96-4147-b393-02902818968b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408816 Oct 14 17:49:57.087674 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Fri Oct 14 17:49:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:49:57.108781 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_api:SELECT=14 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:57.114584 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-94e61dae-bb69-409a-a75f-d21c4c4056ca admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:49:57.122253 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-94e61dae-bb69-409a-a75f-d21c4c4056ca admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014816 Oct 14 17:49:57.122768 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Fri Oct 14 17:49:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:49:57.135551 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-ed82f8e0-3298-4795-b4d1-b9e962c6a511 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:49:57.142773 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-ed82f8e0-3298-4795-b4d1-b9e962c6a511 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010943 Oct 14 17:49:57.143293 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Fri Oct 14 17:49:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:49:57.154370 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-3ce4a068-ad2a-477b-a9b8-d1c265f2aa24 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:49:57.162580 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-3ce4a068-ad2a-477b-a9b8-d1c265f2aa24 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011722 Oct 14 17:49:57.163095 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Fri Oct 14 17:49:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:49:57.174110 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-e109dea3-a590-49e8-a566-439913093771 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:49:57.181199 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-e109dea3-a590-49e8-a566-439913093771 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010619 Oct 14 17:49:57.181701 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Fri Oct 14 17:49:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:53:00.402178 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-3ce4a068-ad2a-477b-a9b8-d1c265f2aa24 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:53:00.403191 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-3ce4a068-ad2a-477b-a9b8-d1c265f2aa24 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 14 17:53:00.403591 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:53:00.545685 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_api:SELECT=6 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:53:00.708958 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-e1d3d7b6-7044-4b9e-a481-4d28a53b55f0 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:53:00.714091 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7b6-7044-4b9e-a481-4d28a53b55f0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:53:00.714558 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7b6-7044-4b9e-a481-4d28a53b55f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:53:00.714981 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7b6-7044-4b9e-a481-4d28a53b55f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:53:00.715689 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7b6-7044-4b9e-a481-4d28a53b55f0 admin admin] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:53:00.716153 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7b6-7044-4b9e-a481-4d28a53b55f0 admin admin] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:53:00.716568 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-e1d3d7b6-7044-4b9e-a481-4d28a53b55f0 admin admin] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:53:00.748548 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-e1d3d7b6-7044-4b9e-a481-4d28a53b55f0 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.204013 Oct 14 17:53:00.749094 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Oct 14 17:53:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:53:01.833816 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-3ce4a068-ad2a-477b-a9b8-d1c265f2aa24 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:53:01.834854 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-3ce4a068-ad2a-477b-a9b8-d1c265f2aa24 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 14 17:53:01.835251 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:53:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:53:02.028730 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-52e20688-7f1e-4827-bb4d-9f7b16bb8762 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:53:02.032418 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-52e20688-7f1e-4827-bb4d-9f7b16bb8762 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:53:02.032887 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-52e20688-7f1e-4827-bb4d-9f7b16bb8762 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:53:02.033336 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-52e20688-7f1e-4827-bb4d-9f7b16bb8762 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:53:02.034042 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-52e20688-7f1e-4827-bb4d-9f7b16bb8762 admin admin] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:53:02.034480 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-52e20688-7f1e-4827-bb4d-9f7b16bb8762 admin admin] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:53:02.034887 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-52e20688-7f1e-4827-bb4d-9f7b16bb8762 admin admin] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:53:02.054639 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-52e20688-7f1e-4827-bb4d-9f7b16bb8762 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.078370 Oct 14 17:53:02.055168 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Oct 14 17:53:01 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:53:13.534726 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-3ce4a068-ad2a-477b-a9b8-d1c265f2aa24 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:53:13.535774 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-3ce4a068-ad2a-477b-a9b8-d1c265f2aa24 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 14 17:53:13.536216 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:53:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:53:13.680856 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_cell0:SELECT=4 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:53:13.681570 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_cell1:SELECT=4 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:53:13.682184 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_api:SELECT=8 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:53:13.729832 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-c9908d54-fb40-49b2-b1f7-18d633e0926d admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:53:13.733202 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-c9908d54-fb40-49b2-b1f7-18d633e0926d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:53:13.733681 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-c9908d54-fb40-49b2-b1f7-18d633e0926d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:53:13.734114 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-c9908d54-fb40-49b2-b1f7-18d633e0926d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:53:13.734834 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-c9908d54-fb40-49b2-b1f7-18d633e0926d admin admin] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:53:13.735283 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-c9908d54-fb40-49b2-b1f7-18d633e0926d admin admin] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:53:13.735701 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-c9908d54-fb40-49b2-b1f7-18d633e0926d admin admin] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:53:13.760961 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-c9908d54-fb40-49b2-b1f7-18d633e0926d admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.084618 Oct 14 17:53:13.761440 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Oct 14 17:53:13 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:53:14.838410 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-3ce4a068-ad2a-477b-a9b8-d1c265f2aa24 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:53:14.839453 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-3ce4a068-ad2a-477b-a9b8-d1c265f2aa24 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 14 17:53:14.839866 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Fri Oct 14 17:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:53:15.031242 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-eb0a8545-b88b-4023-bfe6-24a5a2e8da3e admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:53:15.034662 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-eb0a8545-b88b-4023-bfe6-24a5a2e8da3e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:53:15.035133 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-eb0a8545-b88b-4023-bfe6-24a5a2e8da3e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:53:15.035559 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-eb0a8545-b88b-4023-bfe6-24a5a2e8da3e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:53:15.036301 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-eb0a8545-b88b-4023-bfe6-24a5a2e8da3e admin admin] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:53:15.036747 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-eb0a8545-b88b-4023-bfe6-24a5a2e8da3e admin admin] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:53:15.037160 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-eb0a8545-b88b-4023-bfe6-24a5a2e8da3e admin admin] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:53:15.059046 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-eb0a8545-b88b-4023-bfe6-24a5a2e8da3e admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.079222 Oct 14 17:53:15.059505 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Fri Oct 14 17:53:14 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:54:14.382167 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: Fri Oct 14 17:54:14 2022 - graceful shutdown triggered... Oct 14 17:54:14.381900 dv-cinder-749155-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 14 17:54:14.383180 dv-cinder-749155-15-iscsi devstack@n-api.service[103623]: Gracefully killing worker 1 (pid: 103623)... Oct 14 17:54:14.384225 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: Gracefully killing worker 2 (pid: 103624)... Oct 14 17:54:14.510177 dv-cinder-749155-15-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_api:SELECT=4 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:54:15.382527 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: worker 1 buried after 1 seconds Oct 14 17:54:15.382922 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: worker 2 buried after 1 seconds Oct 14 17:54:15.382922 dv-cinder-749155-15-iscsi devstack@n-api.service[103622]: goodbye to uWSGI. Oct 14 17:54:15.384904 dv-cinder-749155-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 14 17:54:15.385454 dv-cinder-749155-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 14 17:54:15.388324 dv-cinder-749155-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 14 17:54:15.401350 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 17:54:15 2022] *** Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: nodename: dv-cinder-749155-15-iscsi Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: machine: x86_64 Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: clock source: unix Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: pcre jit disabled Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: detected number of CPU cores: 4 Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: current working directory: / Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: detected binary path: /usr/bin/uwsgi-core Oct 14 17:54:15.404040 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: your processes number limit is 47680 Oct 14 17:54:15.404882 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: your memory page size is 4096 bytes Oct 14 17:54:15.404882 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: detected max file descriptor number: 2048 Oct 14 17:54:15.404882 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: lock engine: pthread robust mutexes Oct 14 17:54:15.404882 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: thunder lock: enabled Oct 14 17:54:15.404882 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 14 17:54:15.404882 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 17:54:15.447651 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: Python main interpreter initialized at 0x55d2efad39c0 Oct 14 17:54:15.447651 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: python threads support enabled Oct 14 17:54:15.447651 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: your server socket listen backlog is limited to 100 connections Oct 14 17:54:15.447651 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: your mercy for graceful operations on workers is 90 seconds Oct 14 17:54:15.447651 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 17:54:15.448031 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: *** Operational MODE: preforking *** Oct 14 17:54:15.449939 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: *** uWSGI is running in multiple interpreter mode *** Oct 14 17:54:15.449939 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: spawned uWSGI master process (pid: 118637) Oct 14 17:54:15.449078 dv-cinder-749155-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 14 17:54:15.450341 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: spawned uWSGI worker 1 (pid: 118655, cores: 1) Oct 14 17:54:15.450845 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: spawned uWSGI worker 2 (pid: 118656, cores: 1) Oct 14 17:54:15.451323 dv-cinder-749155-15-iscsi devstack@n-api.service[118637]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 17:54:16.122821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 17:54:16.124297 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 17:54:17.284080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:54:17.284080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: from cryptography.utils import int_from_bytes Oct 14 17:54:17.284805 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:54:17.284805 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: from cryptography.utils import int_from_bytes Oct 14 17:54:17.297780 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:54:17.297780 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: from cryptography.utils import int_from_bytes Oct 14 17:54:17.298333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:54:17.298333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: from cryptography.utils import int_from_bytes Oct 14 17:54:19.713464 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 17:54:19.714034 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 17:54:19.714301 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 17:54:19.714548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 17:54:19.714801 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 17:54:19.715191 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.715520 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.715837 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.716183 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.716514 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.716826 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.717147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.717465 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.717791 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.718048 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.718374 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.718854 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-15-iscsi {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.719178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.719485 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.719798 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.720148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.720458 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.720778 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.721092 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.721592 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.723203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.723203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.723203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.723582 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.723818 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.724163 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.724483 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.724786 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.725114 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.725431 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.725829 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-15-iscsi {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.726148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.726459 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.727321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.728202 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.728202 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.728429 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.728700 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.729018 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.729343 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.729656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.729979 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.730318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.730640 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.730919 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.731222 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.731530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.731853 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.732254 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.732557 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.732821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.733111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.733433 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.733753 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.734074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.734320 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.734570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.734885 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.735202 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.735508 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.735812 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.736144 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.736447 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.736749 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.737051 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.737354 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.737657 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.737973 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.738286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.738606 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.738910 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.739226 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.739626 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.739944 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.740204 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.740546 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.740860 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.741164 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.741487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.741709 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 17:54:19.742254 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.742408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 17:54:19.743122 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.743122 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.744119 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 17:54:19.744288 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.744438 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 17:54:19.744590 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.744753 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 17:54:19.744753 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.745029 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.745178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.745318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.745318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.745589 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.745727 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.746437 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.746596 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.746743 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.746892 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.747032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.747190 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.747341 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.747488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.747635 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.747775 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.747956 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.748103 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.748252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.748393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.748538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.748677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.748823 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-15-iscsi {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.748974 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.749135 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.749276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.749276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.749538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.749694 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.749843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.749983 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.750129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.750320 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.750473 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.750614 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.750763 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.750921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.751070 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.751210 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.751357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.751693 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.751849 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.752024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.752167 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.752314 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.752455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.752604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.752604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.752878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.753026 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.753176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.753322 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.753469 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.753620 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.753765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.753914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.754054 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.754192 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.754336 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.754484 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.754633 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.754789 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.754935 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-15-iscsi {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.755084 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.755230 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.755378 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.755530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.755677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.755817 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.756093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.756093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.756807 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.756956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.757115 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.757273 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.757422 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.757594 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.757863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.758034 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.758594 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.758754 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.758904 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.759046 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.759205 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.759347 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.759493 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.759665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.762993 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.763175 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.763333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.763478 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.763626 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.763774 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.763951 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.764182 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.764334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.764334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.765922 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.766195 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.766367 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.767017 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.767173 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.767316 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.767463 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.767631 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.768033 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.768204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.768356 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.768505 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.768645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.768792 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.768956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.769097 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.769247 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.769396 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.769555 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.769698 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.769846 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.769993 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.770141 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.770282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.770421 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.770578 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.770725 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.770865 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.771106 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.771274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.771417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.771569 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.771717 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.771864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.772038 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.772179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.772334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.772334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.772682 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.772900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.772900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.772900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.772900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.772900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.773575 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.773776 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.773998 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.774192 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.774365 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.774516 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.774656 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.774808 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.774972 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.775647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.775823 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.776004 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.776172 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.776395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.776549 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.777010 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.777251 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.777399 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.777541 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.777797 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.777944 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.778181 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.778329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.778470 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.778610 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.778760 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.778900 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.779048 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.779197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.779356 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.779508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.779650 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.779807 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.780013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.780163 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.780313 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.780466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.780865 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.781015 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.781164 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.781304 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.781443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.781589 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.781730 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.781876 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.782040 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.782182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.782322 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.782460 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.782649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.782808 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.782808 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.783182 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.783329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.783477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.783616 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.783768 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.783927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.784101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.784243 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.784383 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.784521 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.784674 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.784814 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.784965 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.785104 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.785244 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.785383 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.785535 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.785674 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.785813 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.785969 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.786118 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.786257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.786422 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.786639 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.786802 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.787232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.787468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.787614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.787754 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.788069 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.788296 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.788460 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.788617 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.788759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.788907 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.789059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.789200 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.789878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.790577 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.790745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.790888 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.791028 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.791169 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.791319 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.791470 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.791611 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.791750 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.791917 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.792078 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.792229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.792384 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.792526 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.792716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.792869 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.793028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.793259 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.793407 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.793566 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.793716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.793864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.794011 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.794168 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.794168 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.794450 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.794596 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.794744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.794963 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.795114 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.795261 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.795410 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.795573 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.795721 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.795890 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.796040 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.796179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.796318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.796457 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.796625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.796847 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.797274 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.797422 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.797664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.797820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.797980 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.798845 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.799009 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.799152 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:54:19.799305 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.799455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.799611 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.799753 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.799967 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.799967 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.800240 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.800391 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.800556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.800556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.800832 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.800832 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.801104 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.801242 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.801394 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.801535 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.801675 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.801823 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.801977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.802127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.802275 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.802431 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.802587 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.802774 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.802920 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.803069 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.803225 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.803446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.803599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.803742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.803900 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.804104 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.804251 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.804409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.804549 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.804697 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.804839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.805076 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.805803 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.805968 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.806110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.806250 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.806398 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.806539 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.806686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.806845 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.807088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.807507 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.807684 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.807955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.808114 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.808280 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.808587 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.808741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.808895 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.809044 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.809191 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.809338 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.809477 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.809644 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.809802 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.809942 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.810091 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.810231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.810378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.810525 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.810525 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.810805 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.810945 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.811092 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.811239 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.811392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.811543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.811683 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.811683 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.811977 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.812120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.812272 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.812413 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.812552 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.812691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.812879 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.813025 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.813175 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.813326 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.813581 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.813581 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.813851 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.813991 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.814138 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.814287 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.814510 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.814681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.814824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.814972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.815119 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.815268 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.815419 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.816203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.816358 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.816508 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.816648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.816787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.816934 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.817097 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.817592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.817743 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.817884 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.818154 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.818301 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.818450 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.818794 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.818942 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.819082 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.819232 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.819394 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.819541 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.819688 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.819917 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.820139 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.820304 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.820459 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.821132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.821132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.821997 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.822144 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.822296 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.822446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.822595 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.822745 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.822933 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.823093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.823245 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.823402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.823579 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.823813 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.824006 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.824200 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.824357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.824498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.824645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.824795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.825486 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.825648 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.825792 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.825933 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.826073 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.826236 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.826378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.826528 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.826669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.826810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.826958 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.827099 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.827248 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.827821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.828059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.828322 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.828477 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.828620 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.829258 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.829428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.829702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.829864 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.830025 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.830254 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.830568 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.830681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.830798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.830912 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.830994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831073 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831232 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831315 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831481 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831577 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831901 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.831986 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832069 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832346 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832429 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832429 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832589 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832680 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832770 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832854 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.832959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.833045 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.833135 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.833227 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.833310 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.833392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.833481 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.833564 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.833645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.833735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.833931 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834199 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834295 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834380 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834462 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834462 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834865 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.834955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835068 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835153 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835242 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835338 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835428 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835512 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835600 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835683 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835776 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835866 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.835973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.836065 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.836201 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.836441 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.836562 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.836693 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.836788 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.836873 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.836970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.837054 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.837218 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.837317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.837389 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.837499 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.837613 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.837953 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838040 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838216 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838326 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838419 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838504 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838593 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838682 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838870 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.838979 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839073 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839157 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839239 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839411 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839501 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839584 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839763 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839846 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.839964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840057 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840152 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840235 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840587 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840670 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840751 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840841 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.840935 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841019 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841100 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841278 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841361 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841540 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841628 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841889 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.841995 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842090 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842273 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842363 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842539 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842621 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842798 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842880 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842975 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.842975 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.843116 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.843205 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.843288 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.843369 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.843462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.843547 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.843636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.843636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.843793 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844006 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844006 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844165 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844250 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844323 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844471 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844548 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844640 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844814 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.844994 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845330 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845515 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845770 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845859 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.845954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846052 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846465 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846548 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846718 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846801 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846882 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.846972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.847055 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.847144 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.847226 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.847315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.847398 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.847489 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.847578 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.847662 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.847739 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.847829 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.848126 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.848293 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.848381 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.848464 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.848546 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.848628 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.848723 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.848804 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.848874 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.848955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849036 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849224 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849308 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849391 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849463 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849544 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849816 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.849987 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.850111 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.850210 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.850303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.850395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.850479 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.850568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.850651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.850747 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.850837 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.850928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.851011 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.851093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.851093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.851273 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.851346 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.851428 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.851509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.851590 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.851678 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.852383 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.852600 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.852968 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853060 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853358 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853447 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853447 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853607 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853763 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853843 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853914 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853984 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853984 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.853984 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.854178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.854251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.854328 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.854406 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.854513 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.854595 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.855173 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.855272 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.855272 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.855417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.855497 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.855569 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.855646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.855723 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.856543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.856656 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.856734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.856804 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.856804 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.857083 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.857396 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.857708 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.857802 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.858060 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.858174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.858333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.858478 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.858643 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.858771 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.858951 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.859105 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.859264 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.859437 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.859576 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.859769 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.860013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.860124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.860339 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.860460 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.860657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.860755 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.861291 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.861398 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.861473 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.861556 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.861638 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.861712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.861906 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.862068 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.862215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.862310 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.862525 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.862685 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.862865 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.862954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.863174 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.863267 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.863482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.863570 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.863796 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.863920 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.864132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.864231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.864441 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.864542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.864770 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.864874 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.865082 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.865179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.865388 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.865484 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.865699 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.865801 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.866007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.866113 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.866320 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.866416 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.866626 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.866737 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.866923 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.867064 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.867237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.867406 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.867634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.867788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.867978 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.868082 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.868364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.868470 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.868603 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.868694 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.868921 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.869041 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.869229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.869329 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.869553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.869652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.869876 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.869978 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.870188 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.870279 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.870496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.870589 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.870816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.870907 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.871133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.871250 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.871433 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.871530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.871748 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.871851 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.872078 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.872193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.872399 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.872505 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.872700 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.872795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.873003 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.873116 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.873312 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.873412 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.873619 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.873727 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.873938 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.874184 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.874344 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.874460 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.874652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.874760 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.874956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.875059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.875277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.875386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.875587 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.875689 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.875935 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.876040 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.876229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.876334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.876538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.876638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.876854 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.876955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.877181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.877276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.877503 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.877595 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.877812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.877912 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.878127 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.878227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.878490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.878607 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.878740 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.878833 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.879048 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.879139 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.879352 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.879451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.879664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.879760 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.879997 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.880093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.880309 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.880416 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.880618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.880711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.880927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.881026 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.881252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.881416 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.881566 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.881658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.881874 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.881965 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.882182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.882275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.882490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.882572 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.882839 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.882947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.883694 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.883801 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.884027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.884319 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.884409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.884644 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.884751 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.884949 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.885040 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.885261 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.885352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.885572 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.885672 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.885881 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.885980 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.886182 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.886274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.886493 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.886602 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.886812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.886906 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.887113 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.887216 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.887433 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.887525 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.887741 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.887842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.888075 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.888186 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.888393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.888499 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.888736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.888824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.889007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.889097 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.889312 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.889406 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.889617 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.889718 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.889923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.890027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.890227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.890329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.890555 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.890646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.890863 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.890963 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.891173 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.891298 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.891487 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.891581 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.891804 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.891925 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.892139 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.892244 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.892467 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.892571 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.892781 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.892888 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.893095 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.893188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.893402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.893501 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.893713 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.893804 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.894028 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.894121 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.894329 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.894428 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.894630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.894732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.894939 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.895039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.895243 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.895343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.895547 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.895646 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.895848 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.895959 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.896178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.896270 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.896482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.896579 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.896785 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.896878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.897086 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.897219 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.897407 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.897535 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.897711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.897853 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.898027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.898164 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.898334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.898479 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.898882 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.899006 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.899102 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.899382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.899486 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.899669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.899761 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.900010 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.900125 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.900379 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.900479 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.900691 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.900791 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.901014 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.901108 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.901331 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.901424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.901645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.901747 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.901950 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.902042 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.902261 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.902360 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.902573 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.902665 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.902879 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.902977 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.903187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.903287 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.903491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.903590 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.903804 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.903936 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.904137 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.904236 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.904461 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.904562 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.904884 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.905017 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.905200 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.905345 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.905509 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.905923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.906194 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.906301 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.906510 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.906608 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.906826 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.906920 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.907136 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.907226 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.907449 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.907542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.907760 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.907862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.908094 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.908237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.908405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.908505 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.908715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.908804 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.909039 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.909153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.909361 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.909455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.909675 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.909767 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.909998 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.910081 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.910310 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.910402 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.910623 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.910705 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.910938 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.911050 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.911259 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.911429 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.911588 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.911680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.911970 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.912236 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.912344 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.912550 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.912642 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.912861 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.912953 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.913169 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.913270 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.913476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.913576 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.913787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.913879 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.914095 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.914197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.914955 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.915171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.915286 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.915456 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.915565 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.915775 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.915903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.916117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.916211 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.916448 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.916555 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.916787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.916897 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.917106 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.917195 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.917418 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.917519 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.917728 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.917826 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.918042 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.918133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.918353 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.918560 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.918682 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.918874 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.919001 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.919251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.919348 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.919519 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.919642 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.919842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.919977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.920182 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.920289 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.920501 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.920589 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.920829 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.920920 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.921134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.921245 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.921438 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.921539 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.921748 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.921841 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.922057 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.922158 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.922359 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.922460 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.922681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.922773 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.922991 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.923084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.923294 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.923386 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.923612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.923710 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.923940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.924037 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.924332 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.924476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.924648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.924827 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.924971 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.925147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.925301 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.925475 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.925610 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.925801 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.925902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.926118 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.926211 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.926433 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.926526 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.927287 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.927400 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.927488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.927572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.927661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.927756 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.927858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.927970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.928057 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.928154 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.928275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.928376 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.928579 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.928679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.928890 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.928990 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.929327 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.929444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.929544 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.929630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.929795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.929916 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.930671 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.930798 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.930983 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.931080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.931297 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.931406 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.931605 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.931712 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.931930 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.932061 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.932246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.932385 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.932551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.932717 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.932854 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.933043 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.933143 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.933364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.933466 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.933687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.933781 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.934008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.934101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.934329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.934434 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.934649 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.934742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.934970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.935070 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.935285 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.935387 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.935607 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.935708 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.935946 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.936042 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.936269 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.936371 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.936579 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.936825 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.936976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.937161 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.937308 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.937480 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.937613 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.937799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.937932 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.938107 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.938248 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.938417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.938550 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.941016 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.941191 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.941350 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.941522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.942546 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.942692 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.942811 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.942924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.943036 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.943164 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.943279 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.943390 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.943509 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.943629 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.943749 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.943871 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.944043 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.944167 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.944292 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.944406 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.944595 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.944762 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.944932 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.945092 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.945250 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.945411 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.945644 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.945860 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.946022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.946180 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.946331 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.946506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.946666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.946810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.946941 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.947078 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.947078 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.947344 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.947483 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.947612 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.947740 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.947891 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.948035 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.948180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.948310 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.948441 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.948571 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.948701 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.948840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.948981 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.949122 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.949252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.949381 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.949516 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.949655 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.949794 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.949925 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.950054 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.950188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.950326 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.950470 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.950612 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.950743 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.950888 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.951158 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.951304 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.951444 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.951576 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.951706 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.951706 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.951965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.952111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.952244 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.952381 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.952511 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.952642 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.952770 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.952770 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.953024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.953153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.953289 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.953419 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.953562 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.953710 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.953841 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.953979 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.954109 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.954246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.954390 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.954528 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.954665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.954797 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.954934 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.955074 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.955213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.955351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.955481 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.955617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.955748 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.955895 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.956041 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.956173 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.956311 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.956311 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.956555 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.956694 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.956834 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.956964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.957101 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.957232 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.957361 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.957504 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.957634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.957771 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.957902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.958043 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.958174 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.958317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.958317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.958577 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.958718 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.958855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.958987 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.959124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.959255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.959384 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.959513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.959641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.959788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.960052 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.960199 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.960341 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.960477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.960607 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.960750 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.960882 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.961021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.961338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.961473 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.961586 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.961710 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.961830 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.961960 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.962093 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.962222 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.962350 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.962487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.962618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.962755 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.962884 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.963013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.963153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.963295 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.963425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.963607 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.963747 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.963896 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.964041 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.964174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.964311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.964442 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.964579 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.964717 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.964856 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.964987 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.965123 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.965255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.965383 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.965513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.965651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.965790 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.965927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.966063 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.966201 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.966340 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.966470 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.966599 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.966735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.966866 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.966995 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.967132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.967263 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.967393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.967530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.967660 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.967823 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.967986 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.968125 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.968263 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.968395 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.968524 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.968660 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.968799 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.968937 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.969072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.969237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.969378 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.969557 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.969781 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.969914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.970120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.970265 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.970454 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.970663 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.970808 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.970938 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.971075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.971205 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.971482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.971628 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.971760 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.971914 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.972047 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.972176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.972319 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.972455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.972593 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.972725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.972880 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.973013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.973187 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.973322 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.973494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.973637 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.973805 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.973938 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.974117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.974251 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.974439 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.974581 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.974751 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.974915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.975223 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.975364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.975503 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.975640 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.975782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.975989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.976125 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.976262 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.976399 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.976529 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.976659 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.977354 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.977610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.977746 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.977928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.978089 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.978237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.978417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.978552 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.978740 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.978877 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 17:54:19.979066 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.979389 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.979708 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.980053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.980372 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.980686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.981017 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.981352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.981673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.981990 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.982418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.982737 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.983061 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.983387 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.984849 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.985186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.985521 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.985844 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.986174 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.986491 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.986834 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.987186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.987522 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.987857 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.988196 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.988509 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.988823 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.989143 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.989471 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.989788 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.990101 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.990409 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.990729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.991043 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.991357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.991759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.991994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.992320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.993238 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.993585 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.993904 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.994219 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.994533 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.994843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.995160 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.995472 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.995786 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.996129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.996442 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.996752 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.997091 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.997430 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.997754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.998084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.998402 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.998730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.999046 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.999374 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:19.999702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.000057 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.000377 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.000717 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.001035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.001352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.001827 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.001993 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.002312 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.002630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.002963 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.003296 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.003606 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.003958 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.004284 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.004611 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.004935 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.005252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.005587 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.005903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.006218 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.006532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.006849 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.007164 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.007485 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.007801 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.008266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.008636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.008920 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.009254 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.009585 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.009900 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.010233 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.010563 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.010916 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.011235 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.011586 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.012464 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.012464 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.012747 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.012887 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:54:20.013100 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 17:54:20.046817 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO dbcounter [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Registered counter for database nova_api Oct 14 17:54:20.067163 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_db.sqlalchemy.engines [None req-7912502a-b927-44dc-8560-473ce66c393a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:54:20.073931 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writer thread running {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:54:20.076316 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO dbcounter [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Registered counter for database nova_api Oct 14 17:54:20.097613 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_db.sqlalchemy.engines [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:54:20.104824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writer thread running {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:54:20.129701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.context [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3910e64-6c9f-4b06-9301-0c1a6426780a(cell1) {{(pid=118655) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 17:54:20.133850 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:54:20.134325 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:54:20.135900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:54:20.136604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:54:20.137043 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:54:20.139023 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:54:20.141013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO dbcounter [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Registered counter for database nova_cell0 Oct 14 17:54:20.144973 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO dbcounter [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Registered counter for database nova_cell1 Oct 14 17:54:20.153188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_db.sqlalchemy.engines [None req-7912502a-b927-44dc-8560-473ce66c393a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:54:20.154874 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_db.sqlalchemy.engines [None req-7912502a-b927-44dc-8560-473ce66c393a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:54:20.160976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.context [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3910e64-6c9f-4b06-9301-0c1a6426780a(cell1) {{(pid=118656) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 17:54:20.161246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writer thread running {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:54:20.162553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writer thread running {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:54:20.165739 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:54:20.166081 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:54:20.167648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:54:20.168423 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:54:20.168874 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:54:20.170886 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:54:20.172926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO dbcounter [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Registered counter for database nova_cell0 Oct 14 17:54:20.177078 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO dbcounter [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Registered counter for database nova_cell1 Oct 14 17:54:20.184559 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_db.sqlalchemy.engines [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:54:20.186923 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_db.sqlalchemy.engines [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:54:20.193868 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writer thread running {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:54:20.195144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writer thread running {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:54:20.310298 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO dbcounter [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Registered counter for database nova_cell0 Oct 14 17:54:20.316918 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_db.sqlalchemy.engines [None req-7912502a-b927-44dc-8560-473ce66c393a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:54:20.321690 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writer thread running {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:54:20.344210 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO dbcounter [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Registered counter for database nova_cell0 Oct 14 17:54:20.350929 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_db.sqlalchemy.engines [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:54:20.356759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writer thread running {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:54:20.641472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: WARNING keystonemiddleware.auth_token [None req-7912502a-b927-44dc-8560-473ce66c393a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 17:54:20.649344 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: WARNING keystonemiddleware.auth_token [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 17:54:20.697404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: WARNING keystonemiddleware.auth_token [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 17:54:20.704941 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: WARNING keystonemiddleware.auth_token [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 17:54:20.994284 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: WARNING keystonemiddleware.auth_token [None req-7912502a-b927-44dc-8560-473ce66c393a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 17:54:21.000270 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: WARNING keystonemiddleware.auth_token [None req-7912502a-b927-44dc-8560-473ce66c393a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 17:54:21.005698 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d2efad39c0 pid: 118655 (default app) Oct 14 17:54:21.046484 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: WARNING keystonemiddleware.auth_token [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 17:54:21.052516 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: WARNING keystonemiddleware.auth_token [None req-272fbd42-a6a2-4a78-bdaf-c100b569c1fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 17:54:21.058122 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d2efad39c0 pid: 118656 (default app) Oct 14 17:54:57.521237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:54:57.522747 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:54:57.524178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:54:57.525383 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:54:59.603699 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3ca5e43d-9bab-4e31-8c42-b6c8f13d5a5f tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] Action: 'create', calling method: .version_select at 0x7fe3db6b94c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1509490230", "metadata": {"Type": "work"}}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:01.355171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3ca5e43d-9bab-4e31-8c42-b6c8f13d5a5f tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.851256 Oct 14 17:55:01.355833 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Oct 14 17:54:57 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3855 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 14 17:55:01.374905 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=3 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:01.375823 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=3 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:01.379628 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=3 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:01.380549 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=3 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:01.838331 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c60c42ef-f4e0-47ed-9326-0a7e26c2e6d1 tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] Calling method '.version_select at 0x7fe3db7030d0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:02.694713 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c60c42ef-f4e0-47ed-9326-0a7e26c2e6d1 tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d" status: 200 len: 354 microversion: 2.1 time: 1.324050 Oct 14 17:55:02.696561 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 1/2] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 17:55:01 2022] GET /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d => generated 354 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:02.710990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-47a98668-f435-44c6-9219-a0c0d6e819fd tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] Calling method '.version_select at 0x7fe3db58b3a0>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:02.815580 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-47a98668-f435-44c6-9219-a0c0d6e819fd tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d" status: 200 len: 354 microversion: 2.1 time: 0.109349 Oct 14 17:55:02.818244 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 17:55:02 2022] GET /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:02.842564 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9c1bfa0c-e6fc-457d-8f06-c0d7b9d89ca8 tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] Calling method '.version_select at 0x7fe3db5cc3a0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:03.010541 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9c1bfa0c-e6fc-457d-8f06-c0d7b9d89ca8 tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d" status: 202 len: 0 microversion: 2.1 time: 0.171763 Oct 14 17:55:03.011512 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Oct 14 17:55:02 2022] DELETE /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:55:03.020629 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5dee5bf7-5907-45d3-8881-80bdf79cc527 tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] Calling method '.version_select at 0x7fe3db58ba60>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:03.123301 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5dee5bf7-5907-45d3-8881-80bdf79cc527 tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d" status: 200 len: 353 microversion: 2.1 time: 0.105949 Oct 14 17:55:03.123788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 17:55:03 2022] GET /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 17:55:04.139802 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c3d1248c-1682-412c-8dd4-28c04cd721ef tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] Calling method '.version_select at 0x7fe3db5cca60>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:04.200938 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-c3d1248c-1682-412c-8dd4-28c04cd721ef tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] HTTP exception thrown: Volume fed4367a-d7e3-4795-96fd-ba09bc3cb99d could not be found. Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c3d1248c-1682-412c-8dd4-28c04cd721ef tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] Request method failure captured: Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d HTTP/1.1 Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaJxTQX7wP2nuVMYlIFlnRDIQ8wAOjh-sXW-rAr6kmvkoD7iCBB_qQMVqblJ1uVMNqZFA7JZkGExrZkrpOf5R31h_qI0U62T0gomPBZhbONLzb8r3hr2SuqKx6IdY7Vf4nr9Rm3hHRnTiZNwionQ_PTWacRfrU-sQD3SOZk1ZDqszzY Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 7c55aced11be4d46890f8d417890c067 Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-VolumesGetTestJSON-362206679 Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 17:55:04.205382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c55aced11be4d46890f8d417890c067", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c55aced11be4d46890f8d417890c067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c55aced11be4d46890f8d417890c067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c55aced11be4d46890f8d417890c067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-VolumesGetTestJSON-362206679 Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 7c55aced11be4d46890f8d417890c067 Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-VolumesGetTestJSON-362206679 Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-VolumesGetTestJSON-362206679-project Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 65d78df9d1e947f9a6cffd2f9e4be22e Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-VolumesGetTestJSON-362206679-project Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Volume fed4367a-d7e3-4795-96fd-ba09bc3cb99d could not be found. Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'fed4367a-d7e3-4795-96fd-ba09bc3cb99d'} Oct 14 17:55:04.206862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fed4367a-d7e3-4795-96fd-ba09bc3cb99d could not be found. (HTTP 404) (Request-ID: req-fe7d014a-e891-4036-9a1b-30f9e8c8775e) Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:55:04.207686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 17:55:04.208927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fed4367a-d7e3-4795-96fd-ba09bc3cb99d could not be found. Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 17:55:04.210009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fed4367a-d7e3-4795-96fd-ba09bc3cb99d could not be found. Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fed4367a-d7e3-4795-96fd-ba09bc3cb99d could not be found. Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c3d1248c-1682-412c-8dd4-28c04cd721ef tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] Returning 404 to user: Volume fed4367a-d7e3-4795-96fd-ba09bc3cb99d could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c3d1248c-1682-412c-8dd4-28c04cd721ef tempest-VolumesGetTestJSON-362206679 tempest-VolumesGetTestJSON-362206679-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d" status: 404 len: 109 microversion: 2.1 time: 0.072273 Oct 14 17:55:04.213035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 3/6] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 17:55:04 2022] GET /compute/v2.1/os-volumes/fed4367a-d7e3-4795-96fd-ba09bc3cb99d => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 17:55:10.643510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-81269e33-39e4-43f3-a240-37457acc5f11 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'create', calling method: .version_select at 0x7fe3db5220d0>, body: {"keypair": {"name": "tempest-keypair-816990243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA10Z+nQKyjdtpG61IYJrGnVNR4mm5hT8ATuqrDeqiawEXJkbXyCO5H9aVDhx2rPIkF2EbrsCFBhZJeSMBqdUj7Ewg5PW269aaOSz4Td5bf/dug4FpNBr/he96tlyxLbKg=="}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:10.839656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-81269e33-39e4-43f3-a240-37457acc5f11 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Getting quotas for project f5488304972c48fab9a2b9711cf7e9c8. Resources: {'key_pairs'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:55:10.858237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-81269e33-39e4-43f3-a240-37457acc5f11 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Getting quotas for user 762e1e38e4234803991187db9b870b9c and project f5488304972c48fab9a2b9711cf7e9c8. Resources: {'key_pairs'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:55:10.993716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-81269e33-39e4-43f3-a240-37457acc5f11 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.879759 Oct 14 17:55:10.994965 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 4/7] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Oct 14 17:55:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:14.974480 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2030982801", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "networks": [{"uuid": "5aabcb51-4f41-478a-ad41-097a224754cd"}]}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:15.281423 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.network.neutron [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] validate_networks() for [('5aabcb51-4f41-478a-ad41-097a224754cd', None, None, None, None, None)] {{(pid=118656) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:55:16.050252 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1319882224", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:16.245773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] validate_networks() for [('d9e10b55-ef20-4f9b-8608-899751152e31', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:55:16.958092 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Flavor limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:55:16.958804 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Image limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:55:16.959459 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Flavor pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:55:16.960009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Image pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:55:16.961406 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:55:16.993406 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:16.994031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:16.997246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:16.998626 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:16.999207 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:17.000173 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:17.074834 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Getting quotas for project bfe90c27e0e44c4794ccff00eac150ca. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:55:17.093117 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Getting quotas for user 07441f3b8a3841b0ba3677ec38fe7f32 and project bfe90c27e0e44c4794ccff00eac150ca. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:55:17.118931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Going to run 1 instances... {{(pid=118656) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:55:17.126393 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118656) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:55:17.358848 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b89dc9e1-251f-40de-a27f-e7b9219a3829 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.030087 Oct 14 17:55:17.359509 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 4/8] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 17:55:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 17:55:17.786563 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:55:17.787086 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:55:17.787693 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:55:17.788154 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:55:17.788561 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:55:17.804739 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:17.805990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:17.806429 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:17.807288 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:17.807913 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:17.808329 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:17.846015 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Getting quotas for project 530fdfc3448a40b7aa85170873d3f0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:55:17.850487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Getting quotas for user c091bf027839447da4c713deb291ed1f and project 530fdfc3448a40b7aa85170873d3f0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:55:17.878869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:55:17.884560 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:55:18.001205 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6c0bf10c-c776-4057-887f-d41fb8763217 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.243384 Oct 14 17:55:18.003974 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 5/9] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 17:55:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 17:55:18.018390 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9721db72-1af4-4f94-b60f-fd90f95949ec tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:18.021641 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9721db72-1af4-4f94-b60f-fd90f95949ec tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:18.069703 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9681619e-5d87-471e-af15-8be547ccf2f3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Action: 'create', calling method: .version_select at 0x7fe3db410550>, body: {"keypair": {"name": "tempest-keypair-1121262332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCb//qymhrrAIbt6NwrGN4K0vHUDQERVr0nyQfoDH1JrwqSKkQ7Uc+SYNi58M0MYvTnH8l5I7tbioW/4wO7FKer9JjQKLuQxg7f3rhd5/0uqOSUNrlnG+jq4HpyOkI0OCA=="}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:18.146897 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-9681619e-5d87-471e-af15-8be547ccf2f3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Getting quotas for project 261d62defa42436cbcc5e712c62b76f4. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:55:18.160977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-9681619e-5d87-471e-af15-8be547ccf2f3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Getting quotas for user b9187955c3cf4b77ba86e67a6f378e6a and project 261d62defa42436cbcc5e712c62b76f4. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:55:18.229816 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9721db72-1af4-4f94-b60f-fd90f95949ec tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:18.253605 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9681619e-5d87-471e-af15-8be547ccf2f3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.882491 Oct 14 17:55:18.254757 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 5/10] 10.222.0.27 () {62 vars in 1200 bytes} [Fri Oct 14 17:55:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 887 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 14 17:55:18.261777 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-801324237", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95ca934d-e2bb-4a19-815c-bde759f0f1d5"}], "security_groups": [{"name": "tempest-securitygroup--424981626"}], "key_name": "tempest-keypair-816990243", "user_data": "}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:18.298665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9721db72-1af4-4f94-b60f-fd90f95949ec tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1215 microversion: 2.1 time: 0.289314 Oct 14 17:55:18.301475 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 6/11] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:18 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1215 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:18.332798 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6ef8e897-aa4f-4a3a-bce3-e53baf580d50 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:18.333978 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6ef8e897-aa4f-4a3a-bce3-e53baf580d50 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:18.585238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6ef8e897-aa4f-4a3a-bce3-e53baf580d50 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:18.602427 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6ef8e897-aa4f-4a3a-bce3-e53baf580d50 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1222 microversion: 2.1 time: 0.299581 Oct 14 17:55:18.608082 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 7/12] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:18 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1222 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:18.640679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.network.neutron [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] validate_networks() for [('95ca934d-e2bb-4a19-815c-bde759f0f1d5', None, None, None, None, None)] {{(pid=118656) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:55:18.902290 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1677995490", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:19.051389 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] validate_networks() for [('d9e10b55-ef20-4f9b-8608-899751152e31', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:55:20.902443 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Flavor limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:55:20.902991 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Image limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:55:20.903325 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Flavor pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:55:20.903943 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:55:20.904886 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:55:20.905370 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:55:20.905777 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:55:20.906426 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Image pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:55:20.906837 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:55:20.909459 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:55:20.933161 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:20.933652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:20.934094 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:20.934847 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:20.935303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:20.935733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:20.938824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:20.939318 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:20.939754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:20.940499 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:20.941131 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:20.941559 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:20.976465 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Getting quotas for project 530fdfc3448a40b7aa85170873d3f0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:55:20.982964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Getting quotas for user c091bf027839447da4c713deb291ed1f and project 530fdfc3448a40b7aa85170873d3f0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:55:20.992855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Getting quotas for project f5488304972c48fab9a2b9711cf7e9c8. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:55:21.000375 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:55:21.002848 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:55:21.004474 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Getting quotas for user 762e1e38e4234803991187db9b870b9c and project f5488304972c48fab9a2b9711cf7e9c8. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:55:21.038160 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Going to run 1 instances... {{(pid=118656) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:55:21.042802 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118656) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:55:21.112324 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e6351190-69fa-4b82-9f2f-7368c3ee1908 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.216631 Oct 14 17:55:21.118949 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 8/13] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 17:55:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 17:55:21.124347 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-408fd077-cac5-468c-9884-85b188e4914c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:21.128226 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-408fd077-cac5-468c-9884-85b188e4914c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:21.151749 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-408fd077-cac5-468c-9884-85b188e4914c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:21.152397 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-408fd077-cac5-468c-9884-85b188e4914c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:21.153285 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-408fd077-cac5-468c-9884-85b188e4914c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:21.153678 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-408fd077-cac5-468c-9884-85b188e4914c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:21.158919 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-408fd077-cac5-468c-9884-85b188e4914c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:21.158919 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-408fd077-cac5-468c-9884-85b188e4914c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:21.190110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a5e287cd-8a8f-4ac3-aa1d-ea90b6d295fd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.933949 Oct 14 17:55:21.198503 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 6/14] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 17:55:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 2943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 17:55:21.207007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-73de4de1-ceeb-474a-969d-032d64ce626a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:21.221331 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-73de4de1-ceeb-474a-969d-032d64ce626a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:21.457866 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-73de4de1-ceeb-474a-969d-032d64ce626a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:21.495307 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-73de4de1-ceeb-474a-969d-032d64ce626a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1222 microversion: 2.1 time: 0.295377 Oct 14 17:55:21.498941 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 7/15] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:21 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:21.510036 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7e907bd1-6aab-44a4-94c0-7a47f7d9b918 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:21.511127 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7e907bd1-6aab-44a4-94c0-7a47f7d9b918 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:21.627990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-408fd077-cac5-468c-9884-85b188e4914c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:21.652524 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-408fd077-cac5-468c-9884-85b188e4914c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1211 microversion: 2.1 time: 0.532150 Oct 14 17:55:21.653631 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 9/16] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:21 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1211 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:21.757088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7e907bd1-6aab-44a4-94c0-7a47f7d9b918 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:21.771198 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7e907bd1-6aab-44a4-94c0-7a47f7d9b918 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1236 microversion: 2.1 time: 0.267861 Oct 14 17:55:21.775034 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 8/17] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:21 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1236 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:21.977066 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-176177932", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e398a6f0-cbb6-41b9-a427-4e2c5e47f4f8"}], "security_groups": [{"name": "tempest-securitygroup--1506415131"}], "key_name": "tempest-keypair-1121262332", "user_data": "}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:22.357487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] validate_networks() for [('e398a6f0-cbb6-41b9-a427-4e2c5e47f4f8', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:55:22.527393 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-33d2f5f5-0ba2-4f31-88e6-a36df2f2ef3e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:22.528468 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-33d2f5f5-0ba2-4f31-88e6-a36df2f2ef3e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:22.548402 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33d2f5f5-0ba2-4f31-88e6-a36df2f2ef3e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:22.549953 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33d2f5f5-0ba2-4f31-88e6-a36df2f2ef3e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:22.550427 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33d2f5f5-0ba2-4f31-88e6-a36df2f2ef3e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:22.551182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33d2f5f5-0ba2-4f31-88e6-a36df2f2ef3e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:22.551648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33d2f5f5-0ba2-4f31-88e6-a36df2f2ef3e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:22.552126 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33d2f5f5-0ba2-4f31-88e6-a36df2f2ef3e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:22.889494 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-33d2f5f5-0ba2-4f31-88e6-a36df2f2ef3e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:22.905993 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-33d2f5f5-0ba2-4f31-88e6-a36df2f2ef3e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1226 microversion: 2.1 time: 0.383196 Oct 14 17:55:22.913367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 9/18] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:22 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1226 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:22.928669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e4a9d800-c153-4e40-9595-8114304e13bc tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:22.930541 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e4a9d800-c153-4e40-9595-8114304e13bc tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:22.945155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e4a9d800-c153-4e40-9595-8114304e13bc tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:22.949425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e4a9d800-c153-4e40-9595-8114304e13bc tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:22.950760 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e4a9d800-c153-4e40-9595-8114304e13bc tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:22.953652 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e4a9d800-c153-4e40-9595-8114304e13bc tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:22.954152 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e4a9d800-c153-4e40-9595-8114304e13bc tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:22.954594 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e4a9d800-c153-4e40-9595-8114304e13bc tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:23.048604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:55:23.049129 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:55:23.049495 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:55:23.050150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:55:23.050561 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:55:23.066487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:23.067195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:23.071267 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:23.072468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:23.073083 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:23.075509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:23.103401 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e4a9d800-c153-4e40-9595-8114304e13bc tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:23.115025 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e4a9d800-c153-4e40-9595-8114304e13bc tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1211 microversion: 2.1 time: 0.199364 Oct 14 17:55:23.116600 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 10/19] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:22 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1211 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:23.122014 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2a9c6919-c88d-4b91-b4c6-fbf9e4b30d46 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:23.123154 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2a9c6919-c88d-4b91-b4c6-fbf9e4b30d46 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:23.130031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a9c6919-c88d-4b91-b4c6-fbf9e4b30d46 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:23.130827 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a9c6919-c88d-4b91-b4c6-fbf9e4b30d46 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:23.131468 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a9c6919-c88d-4b91-b4c6-fbf9e4b30d46 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:23.132386 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a9c6919-c88d-4b91-b4c6-fbf9e4b30d46 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:23.133322 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a9c6919-c88d-4b91-b4c6-fbf9e4b30d46 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:23.133959 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a9c6919-c88d-4b91-b4c6-fbf9e4b30d46 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:23.147838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Getting quotas for project 261d62defa42436cbcc5e712c62b76f4. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:55:23.158587 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Getting quotas for user b9187955c3cf4b77ba86e67a6f378e6a and project 261d62defa42436cbcc5e712c62b76f4. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:55:23.192347 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:55:23.194526 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:55:23.209070 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2a9c6919-c88d-4b91-b4c6-fbf9e4b30d46 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:23.220230 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2a9c6919-c88d-4b91-b4c6-fbf9e4b30d46 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1240 microversion: 2.1 time: 0.101374 Oct 14 17:55:23.221617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 11/20] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:23 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:23.313625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-83a52731-69aa-4c0e-a896-f5173cb12132 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.344853 Oct 14 17:55:23.315269 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 10/21] 10.222.0.27 () {62 vars in 1188 bytes} [Fri Oct 14 17:55:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 14 17:55:23.329701 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-52a7ebdf-99d0-41a4-be6e-3f3be9eb787e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:23.340864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-52a7ebdf-99d0-41a4-be6e-3f3be9eb787e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:23.571804 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-52a7ebdf-99d0-41a4-be6e-3f3be9eb787e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:23.582778 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-52a7ebdf-99d0-41a4-be6e-3f3be9eb787e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:23.584756 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-52a7ebdf-99d0-41a4-be6e-3f3be9eb787e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:23.590415 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-52a7ebdf-99d0-41a4-be6e-3f3be9eb787e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1281 microversion: 2.20 time: 0.264484 Oct 14 17:55:23.609003 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 12/22] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:23 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:23.934011 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b6893e66-66f4-4fb6-816f-6eaaf394278f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:23.934630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b6893e66-66f4-4fb6-816f-6eaaf394278f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:23.941677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6893e66-66f4-4fb6-816f-6eaaf394278f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:23.942168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6893e66-66f4-4fb6-816f-6eaaf394278f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:23.942612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6893e66-66f4-4fb6-816f-6eaaf394278f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:23.943317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6893e66-66f4-4fb6-816f-6eaaf394278f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:23.943778 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6893e66-66f4-4fb6-816f-6eaaf394278f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:23.950310 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6893e66-66f4-4fb6-816f-6eaaf394278f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:24.146990 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4aca50ea-e2cc-4286-8ced-418da699122c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:24.147768 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4aca50ea-e2cc-4286-8ced-418da699122c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:24.158696 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4aca50ea-e2cc-4286-8ced-418da699122c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:24.160681 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4aca50ea-e2cc-4286-8ced-418da699122c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:24.161370 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4aca50ea-e2cc-4286-8ced-418da699122c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:24.162350 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4aca50ea-e2cc-4286-8ced-418da699122c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:24.166112 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4aca50ea-e2cc-4286-8ced-418da699122c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:24.166890 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4aca50ea-e2cc-4286-8ced-418da699122c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:24.243607 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b6893e66-66f4-4fb6-816f-6eaaf394278f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:24.261547 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b6893e66-66f4-4fb6-816f-6eaaf394278f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1218 microversion: 2.1 time: 0.331784 Oct 14 17:55:24.267971 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:23 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1218 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:24.287640 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-972fe0b2-2641-4441-b7c6-9c79c33a6d92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:24.292405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-972fe0b2-2641-4441-b7c6-9c79c33a6d92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:24.315578 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-972fe0b2-2641-4441-b7c6-9c79c33a6d92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:24.316124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-972fe0b2-2641-4441-b7c6-9c79c33a6d92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:24.316626 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-972fe0b2-2641-4441-b7c6-9c79c33a6d92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:24.317328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-972fe0b2-2641-4441-b7c6-9c79c33a6d92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:24.317790 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-972fe0b2-2641-4441-b7c6-9c79c33a6d92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:24.318220 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-972fe0b2-2641-4441-b7c6-9c79c33a6d92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:24.356466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-4aca50ea-e2cc-4286-8ced-418da699122c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:24.365225 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4aca50ea-e2cc-4286-8ced-418da699122c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1267 microversion: 2.1 time: 0.222774 Oct 14 17:55:24.374904 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 13/24] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:24 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:24.457954 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-972fe0b2-2641-4441-b7c6-9c79c33a6d92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:24.469967 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-972fe0b2-2641-4441-b7c6-9c79c33a6d92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1232 microversion: 2.1 time: 0.200157 Oct 14 17:55:24.471011 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 12/25] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:24 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1232 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:24.624859 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:24.625625 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:24.638124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:24.642594 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:24.643331 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:24.645493 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:24.646087 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:24.647382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:24.807845 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:24.822026 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:24.823813 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:24.832505 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1132d584-ef79-45ea-9b1c-85a26ad0d68b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1285 microversion: 2.20 time: 0.214046 Oct 14 17:55:24.833783 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 14/26] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:24 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1285 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:25.301895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4e1e327f-29e9-43b8-96f9-f9cf786e0245 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:25.302513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4e1e327f-29e9-43b8-96f9-f9cf786e0245 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:25.311747 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e1e327f-29e9-43b8-96f9-f9cf786e0245 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:25.312446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e1e327f-29e9-43b8-96f9-f9cf786e0245 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:25.313088 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e1e327f-29e9-43b8-96f9-f9cf786e0245 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:25.313899 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e1e327f-29e9-43b8-96f9-f9cf786e0245 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:25.314604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e1e327f-29e9-43b8-96f9-f9cf786e0245 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:25.315125 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e1e327f-29e9-43b8-96f9-f9cf786e0245 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:25.395424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7a1943ca-986f-47f6-ad10-abc2a1d3d8ea tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:25.396091 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7a1943ca-986f-47f6-ad10-abc2a1d3d8ea tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:25.403766 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4e1e327f-29e9-43b8-96f9-f9cf786e0245 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:25.404644 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7a1943ca-986f-47f6-ad10-abc2a1d3d8ea tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:25.405137 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7a1943ca-986f-47f6-ad10-abc2a1d3d8ea tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:25.405569 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7a1943ca-986f-47f6-ad10-abc2a1d3d8ea tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:25.406271 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7a1943ca-986f-47f6-ad10-abc2a1d3d8ea tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:25.406714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7a1943ca-986f-47f6-ad10-abc2a1d3d8ea tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:25.407965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7a1943ca-986f-47f6-ad10-abc2a1d3d8ea tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:25.411452 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4e1e327f-29e9-43b8-96f9-f9cf786e0245 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1218 microversion: 2.1 time: 0.114385 Oct 14 17:55:25.414139 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 13/27] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:25 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:25.494422 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ccd3d8c9-64ea-4d12-8a68-04360171e8af tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:25.495030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ccd3d8c9-64ea-4d12-8a68-04360171e8af tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:25.508282 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ccd3d8c9-64ea-4d12-8a68-04360171e8af tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:25.508778 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ccd3d8c9-64ea-4d12-8a68-04360171e8af tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:25.509213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ccd3d8c9-64ea-4d12-8a68-04360171e8af tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:25.509920 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ccd3d8c9-64ea-4d12-8a68-04360171e8af tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:25.510377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ccd3d8c9-64ea-4d12-8a68-04360171e8af tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:25.510801 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ccd3d8c9-64ea-4d12-8a68-04360171e8af tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:25.521183 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7a1943ca-986f-47f6-ad10-abc2a1d3d8ea tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:25.533112 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7a1943ca-986f-47f6-ad10-abc2a1d3d8ea tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1267 microversion: 2.1 time: 0.143303 Oct 14 17:55:25.534018 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 15/28] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:25 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:25.579343 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ccd3d8c9-64ea-4d12-8a68-04360171e8af tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:25.590432 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ccd3d8c9-64ea-4d12-8a68-04360171e8af tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1232 microversion: 2.1 time: 0.099621 Oct 14 17:55:25.591766 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 14/29] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:25 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1232 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:25.860172 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:25.860798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:25.873572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:25.874064 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:25.877773 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:25.878886 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:25.880825 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:25.881278 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:25.950222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:25.958533 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:25.965545 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:25.966858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a50fd133-9b23-476a-a3c7-b824388cfe78 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1285 microversion: 2.20 time: 0.111549 Oct 14 17:55:25.967453 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 16/30] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:25 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:26.436773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0e1db909-926c-4fb4-8446-118a8052c49a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:26.437979 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0e1db909-926c-4fb4-8446-118a8052c49a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:26.445842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0e1db909-926c-4fb4-8446-118a8052c49a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:26.450580 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0e1db909-926c-4fb4-8446-118a8052c49a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:26.451205 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0e1db909-926c-4fb4-8446-118a8052c49a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:26.452651 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0e1db909-926c-4fb4-8446-118a8052c49a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:26.454882 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0e1db909-926c-4fb4-8446-118a8052c49a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:26.456287 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0e1db909-926c-4fb4-8446-118a8052c49a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:26.557711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0e1db909-926c-4fb4-8446-118a8052c49a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:26.560697 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bd91fb3c-b685-40d7-a76a-bafd60f37b5d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:26.561710 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-bd91fb3c-b685-40d7-a76a-bafd60f37b5d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:26.572939 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0e1db909-926c-4fb4-8446-118a8052c49a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1218 microversion: 2.1 time: 0.140015 Oct 14 17:55:26.578017 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd91fb3c-b685-40d7-a76a-bafd60f37b5d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:26.578683 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 15/31] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:26 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:26.579055 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd91fb3c-b685-40d7-a76a-bafd60f37b5d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:26.579699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd91fb3c-b685-40d7-a76a-bafd60f37b5d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:26.589875 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd91fb3c-b685-40d7-a76a-bafd60f37b5d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:26.590411 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd91fb3c-b685-40d7-a76a-bafd60f37b5d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:26.590860 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd91fb3c-b685-40d7-a76a-bafd60f37b5d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:26.615842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-06de39e9-d61d-4fb1-b737-1da187bd8728 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:26.618239 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-06de39e9-d61d-4fb1-b737-1da187bd8728 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:26.626452 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06de39e9-d61d-4fb1-b737-1da187bd8728 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:26.631916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06de39e9-d61d-4fb1-b737-1da187bd8728 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:26.633536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06de39e9-d61d-4fb1-b737-1da187bd8728 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:26.634423 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06de39e9-d61d-4fb1-b737-1da187bd8728 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:26.636345 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06de39e9-d61d-4fb1-b737-1da187bd8728 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:26.637686 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06de39e9-d61d-4fb1-b737-1da187bd8728 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:26.721743 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-bd91fb3c-b685-40d7-a76a-bafd60f37b5d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:26.730841 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-bd91fb3c-b685-40d7-a76a-bafd60f37b5d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1267 microversion: 2.1 time: 0.178197 Oct 14 17:55:26.731752 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 17/32] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:26 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:26.763214 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-06de39e9-d61d-4fb1-b737-1da187bd8728 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:26.772158 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-06de39e9-d61d-4fb1-b737-1da187bd8728 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1232 microversion: 2.1 time: 0.161320 Oct 14 17:55:26.773303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 16/33] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:26 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1232 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:26.995843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:26.997458 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:27.007248 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:27.008903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:27.009515 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:27.010371 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:27.010974 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:27.012457 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:27.103795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:27.113354 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:27.115094 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:27.116435 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-527fbf34-4091-48f9-956d-c9474ea97ea7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1285 microversion: 2.20 time: 0.126871 Oct 14 17:55:27.117989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 18/34] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:26 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:27.597609 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bba960dc-044e-4d12-807c-307d9e5552bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:27.598224 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bba960dc-044e-4d12-807c-307d9e5552bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:27.612448 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bba960dc-044e-4d12-807c-307d9e5552bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:27.612969 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bba960dc-044e-4d12-807c-307d9e5552bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:27.613460 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bba960dc-044e-4d12-807c-307d9e5552bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:27.614183 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bba960dc-044e-4d12-807c-307d9e5552bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:27.614641 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bba960dc-044e-4d12-807c-307d9e5552bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:27.615067 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bba960dc-044e-4d12-807c-307d9e5552bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:27.756095 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a2aa478b-d956-42fb-ae3e-4f7fdbbde746 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:27.756710 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a2aa478b-d956-42fb-ae3e-4f7fdbbde746 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:27.771961 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2aa478b-d956-42fb-ae3e-4f7fdbbde746 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:27.772662 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2aa478b-d956-42fb-ae3e-4f7fdbbde746 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:27.775514 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2aa478b-d956-42fb-ae3e-4f7fdbbde746 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:27.776493 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2aa478b-d956-42fb-ae3e-4f7fdbbde746 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:27.803594 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bba960dc-044e-4d12-807c-307d9e5552bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:27.804045 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2aa478b-d956-42fb-ae3e-4f7fdbbde746 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:27.805110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2aa478b-d956-42fb-ae3e-4f7fdbbde746 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:27.842187 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bba960dc-044e-4d12-807c-307d9e5552bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1218 microversion: 2.1 time: 0.244579 Oct 14 17:55:27.843496 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 17/35] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:27 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:27.888566 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-cdcbacf5-e354-40b5-8bd2-51fcfecf445f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:27.889482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-cdcbacf5-e354-40b5-8bd2-51fcfecf445f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:27.899447 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdcbacf5-e354-40b5-8bd2-51fcfecf445f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:27.900227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdcbacf5-e354-40b5-8bd2-51fcfecf445f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:27.901111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdcbacf5-e354-40b5-8bd2-51fcfecf445f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:27.902272 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdcbacf5-e354-40b5-8bd2-51fcfecf445f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:27.903244 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdcbacf5-e354-40b5-8bd2-51fcfecf445f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:27.904850 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdcbacf5-e354-40b5-8bd2-51fcfecf445f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:27.910052 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a2aa478b-d956-42fb-ae3e-4f7fdbbde746 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:27.922752 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a2aa478b-d956-42fb-ae3e-4f7fdbbde746 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1275 microversion: 2.1 time: 0.170458 Oct 14 17:55:27.923349 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 19/36] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:27 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:28.011037 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-cdcbacf5-e354-40b5-8bd2-51fcfecf445f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:28.025636 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-cdcbacf5-e354-40b5-8bd2-51fcfecf445f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1232 microversion: 2.1 time: 0.148769 Oct 14 17:55:28.027125 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 18/37] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:27 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1232 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:28.143051 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:28.143659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:28.150188 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:28.150674 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:28.151098 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:28.151790 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:28.152269 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:28.152680 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:28.214583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:28.222595 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:28.224057 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:28.225186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1707bea9-b74c-455e-a56a-794baa3373f7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.086034 Oct 14 17:55:28.225774 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 20/38] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:28 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:28.873352 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d81bd68f-935b-4cd4-8f4f-008d1da315e9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:28.874080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d81bd68f-935b-4cd4-8f4f-008d1da315e9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:28.899789 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d81bd68f-935b-4cd4-8f4f-008d1da315e9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:28.902085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d81bd68f-935b-4cd4-8f4f-008d1da315e9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:28.902565 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d81bd68f-935b-4cd4-8f4f-008d1da315e9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:28.909686 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d81bd68f-935b-4cd4-8f4f-008d1da315e9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:28.912326 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d81bd68f-935b-4cd4-8f4f-008d1da315e9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:28.912792 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d81bd68f-935b-4cd4-8f4f-008d1da315e9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:28.947968 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f0659f09-7eae-4d59-afc6-69b928751152 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:28.949122 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f0659f09-7eae-4d59-afc6-69b928751152 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:28.960103 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0659f09-7eae-4d59-afc6-69b928751152 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:28.964186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0659f09-7eae-4d59-afc6-69b928751152 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:28.965046 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0659f09-7eae-4d59-afc6-69b928751152 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:28.969152 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0659f09-7eae-4d59-afc6-69b928751152 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:28.969780 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0659f09-7eae-4d59-afc6-69b928751152 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:28.970348 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0659f09-7eae-4d59-afc6-69b928751152 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:29.181664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d81bd68f-935b-4cd4-8f4f-008d1da315e9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:29.187703 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f0659f09-7eae-4d59-afc6-69b928751152 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:29.194783 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d81bd68f-935b-4cd4-8f4f-008d1da315e9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1274 microversion: 2.1 time: 0.323671 Oct 14 17:55:29.197165 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 19/39] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:28 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1274 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:29.206870 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f0659f09-7eae-4d59-afc6-69b928751152 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1273 microversion: 2.1 time: 0.264413 Oct 14 17:55:29.208241 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 21/40] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:28 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:55:29.208696 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c78bfcbc-5774-4304-9570-9d3172e7cc18 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:29.210622 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c78bfcbc-5774-4304-9570-9d3172e7cc18 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:29.229675 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c78bfcbc-5774-4304-9570-9d3172e7cc18 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:29.230785 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c78bfcbc-5774-4304-9570-9d3172e7cc18 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:29.231840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c78bfcbc-5774-4304-9570-9d3172e7cc18 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:29.233980 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c78bfcbc-5774-4304-9570-9d3172e7cc18 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:29.235661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c78bfcbc-5774-4304-9570-9d3172e7cc18 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:29.236703 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c78bfcbc-5774-4304-9570-9d3172e7cc18 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:29.251288 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:29.252007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:29.259352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:29.259851 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:29.270724 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:29.271504 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:29.271991 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:29.272415 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:29.962871 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c78bfcbc-5774-4304-9570-9d3172e7cc18 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:29.982836 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c78bfcbc-5774-4304-9570-9d3172e7cc18 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1232 microversion: 2.1 time: 0.784592 Oct 14 17:55:29.989462 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 20/41] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:29 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1232 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:30.057796 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:30.090125 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:30.092323 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:30.098456 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f41a45e4-4a66-4059-8d66-e36a210cf39c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.847222 Oct 14 17:55:30.100315 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:29 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:30.224275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-36c471f4-ac4f-4765-a1e9-77efc1bd64af tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:30.224931 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-36c471f4-ac4f-4765-a1e9-77efc1bd64af tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:30.234030 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c7b71066-3e48-4bec-92cb-0d64c34c5ed5 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:30.235167 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c7b71066-3e48-4bec-92cb-0d64c34c5ed5 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:30.243044 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36c471f4-ac4f-4765-a1e9-77efc1bd64af tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:30.247120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c7b71066-3e48-4bec-92cb-0d64c34c5ed5 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:30.253084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c7b71066-3e48-4bec-92cb-0d64c34c5ed5 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:30.253454 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c7b71066-3e48-4bec-92cb-0d64c34c5ed5 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:30.256135 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36c471f4-ac4f-4765-a1e9-77efc1bd64af tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:30.256523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c7b71066-3e48-4bec-92cb-0d64c34c5ed5 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:30.259725 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36c471f4-ac4f-4765-a1e9-77efc1bd64af tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:30.260442 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c7b71066-3e48-4bec-92cb-0d64c34c5ed5 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:30.260720 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36c471f4-ac4f-4765-a1e9-77efc1bd64af tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:30.260881 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c7b71066-3e48-4bec-92cb-0d64c34c5ed5 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:30.261140 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36c471f4-ac4f-4765-a1e9-77efc1bd64af tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:30.261568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36c471f4-ac4f-4765-a1e9-77efc1bd64af tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:30.598148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-36c471f4-ac4f-4765-a1e9-77efc1bd64af tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:30.618407 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-36c471f4-ac4f-4765-a1e9-77efc1bd64af tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.394896 Oct 14 17:55:30.620394 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 21/43] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:30 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:30.702446 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c7b71066-3e48-4bec-92cb-0d64c34c5ed5 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:30.710311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c7b71066-3e48-4bec-92cb-0d64c34c5ed5 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.480409 Oct 14 17:55:30.714019 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 23/44] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:30 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:31.020418 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-23221179-fb13-4e9a-bda3-8ca38863cb15 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:31.021515 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-23221179-fb13-4e9a-bda3-8ca38863cb15 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:31.029990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23221179-fb13-4e9a-bda3-8ca38863cb15 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:31.031266 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23221179-fb13-4e9a-bda3-8ca38863cb15 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:31.031727 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23221179-fb13-4e9a-bda3-8ca38863cb15 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:31.033469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23221179-fb13-4e9a-bda3-8ca38863cb15 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:31.033942 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23221179-fb13-4e9a-bda3-8ca38863cb15 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:31.034376 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23221179-fb13-4e9a-bda3-8ca38863cb15 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:31.132496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:31.135388 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:31.145182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=4 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:31.147558 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:31.149178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:31.151210 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:31.152869 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:31.154076 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:31.155380 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:31.220500 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-23221179-fb13-4e9a-bda3-8ca38863cb15 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:31.230414 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-23221179-fb13-4e9a-bda3-8ca38863cb15 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1288 microversion: 2.1 time: 0.214255 Oct 14 17:55:31.231421 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 22/45] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:31 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1288 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:31.257337 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:31.270005 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:31.271450 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:31.272587 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fd21159b-e094-42ed-8216-3c52759b2d5a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.146942 Oct 14 17:55:31.273150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:31 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:31.644884 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f3ce9a58-1a07-4ce4-9128-b8b4b0f3caca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:31.645499 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f3ce9a58-1a07-4ce4-9128-b8b4b0f3caca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:31.651744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3ce9a58-1a07-4ce4-9128-b8b4b0f3caca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:31.652263 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3ce9a58-1a07-4ce4-9128-b8b4b0f3caca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:31.652698 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3ce9a58-1a07-4ce4-9128-b8b4b0f3caca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:31.653597 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3ce9a58-1a07-4ce4-9128-b8b4b0f3caca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:31.654053 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3ce9a58-1a07-4ce4-9128-b8b4b0f3caca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:31.654477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3ce9a58-1a07-4ce4-9128-b8b4b0f3caca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:31.723161 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f3ce9a58-1a07-4ce4-9128-b8b4b0f3caca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:31.732939 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f3ce9a58-1a07-4ce4-9128-b8b4b0f3caca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.091903 Oct 14 17:55:31.733858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 23/47] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:31 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:31.743344 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-41a0f0b4-b1e7-4cd4-aa4a-e0de746a0289 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:31.744143 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-41a0f0b4-b1e7-4cd4-aa4a-e0de746a0289 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:31.750722 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-41a0f0b4-b1e7-4cd4-aa4a-e0de746a0289 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:31.752110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-41a0f0b4-b1e7-4cd4-aa4a-e0de746a0289 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:31.752649 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-41a0f0b4-b1e7-4cd4-aa4a-e0de746a0289 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:31.753491 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-41a0f0b4-b1e7-4cd4-aa4a-e0de746a0289 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:31.754045 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-41a0f0b4-b1e7-4cd4-aa4a-e0de746a0289 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:31.754587 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-41a0f0b4-b1e7-4cd4-aa4a-e0de746a0289 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:31.910083 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-41a0f0b4-b1e7-4cd4-aa4a-e0de746a0289 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:31.913456 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=100 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:31.919653 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-41a0f0b4-b1e7-4cd4-aa4a-e0de746a0289 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.180499 Oct 14 17:55:31.921033 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 25/48] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:31 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:32.254247 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-03d5826c-33bc-4d2f-8b9b-e64d84852c93 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:32.254863 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-03d5826c-33bc-4d2f-8b9b-e64d84852c93 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:32.257858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:32.262102 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03d5826c-33bc-4d2f-8b9b-e64d84852c93 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:32.262584 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03d5826c-33bc-4d2f-8b9b-e64d84852c93 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:32.263009 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03d5826c-33bc-4d2f-8b9b-e64d84852c93 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:32.263789 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03d5826c-33bc-4d2f-8b9b-e64d84852c93 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:32.264259 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03d5826c-33bc-4d2f-8b9b-e64d84852c93 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:32.264677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03d5826c-33bc-4d2f-8b9b-e64d84852c93 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:32.300050 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:32.300659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:32.307473 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:32.307986 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:32.308412 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:32.309294 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:32.309742 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:32.310163 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:32.328326 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-03d5826c-33bc-4d2f-8b9b-e64d84852c93 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:32.336604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-03d5826c-33bc-4d2f-8b9b-e64d84852c93 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1288 microversion: 2.1 time: 0.085783 Oct 14 17:55:32.338202 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 24/49] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:32 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:32.378460 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:32.387975 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:32.389647 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:32.390774 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d789a540-8132-4537-9683-4208d74f917a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.094574 Oct 14 17:55:32.391459 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:32 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:32.755737 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-fe0e42e4-d78a-4a79-be18-dd9054f1c68a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:32.756698 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-fe0e42e4-d78a-4a79-be18-dd9054f1c68a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:32.764689 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fe0e42e4-d78a-4a79-be18-dd9054f1c68a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:32.765510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fe0e42e4-d78a-4a79-be18-dd9054f1c68a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:32.766414 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fe0e42e4-d78a-4a79-be18-dd9054f1c68a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:32.767074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fe0e42e4-d78a-4a79-be18-dd9054f1c68a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:32.767890 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fe0e42e4-d78a-4a79-be18-dd9054f1c68a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:32.768498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fe0e42e4-d78a-4a79-be18-dd9054f1c68a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:32.790742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=100 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:32.860338 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-fe0e42e4-d78a-4a79-be18-dd9054f1c68a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:32.869358 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-fe0e42e4-d78a-4a79-be18-dd9054f1c68a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.117472 Oct 14 17:55:32.870550 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 25/51] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:32 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:32.948001 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f2119b16-98e0-42ef-b9c0-ef9a1d9e31c2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:32.948918 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f2119b16-98e0-42ef-b9c0-ef9a1d9e31c2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:32.956177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2119b16-98e0-42ef-b9c0-ef9a1d9e31c2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:32.956657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2119b16-98e0-42ef-b9c0-ef9a1d9e31c2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:32.957289 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2119b16-98e0-42ef-b9c0-ef9a1d9e31c2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:32.957923 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2119b16-98e0-42ef-b9c0-ef9a1d9e31c2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:32.958367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2119b16-98e0-42ef-b9c0-ef9a1d9e31c2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:32.958777 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2119b16-98e0-42ef-b9c0-ef9a1d9e31c2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:33.213650 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f2119b16-98e0-42ef-b9c0-ef9a1d9e31c2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:33.228593 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f2119b16-98e0-42ef-b9c0-ef9a1d9e31c2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.286389 Oct 14 17:55:33.230906 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 27/52] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:32 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:33.361721 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-db5d8e87-903a-489f-9587-4ee8d6fdce86 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:33.363542 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-db5d8e87-903a-489f-9587-4ee8d6fdce86 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:33.371623 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:33.372323 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=26 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:33.374373 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db5d8e87-903a-489f-9587-4ee8d6fdce86 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:33.374818 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db5d8e87-903a-489f-9587-4ee8d6fdce86 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:33.375246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db5d8e87-903a-489f-9587-4ee8d6fdce86 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:33.376080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db5d8e87-903a-489f-9587-4ee8d6fdce86 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:33.376681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db5d8e87-903a-489f-9587-4ee8d6fdce86 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:33.377093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db5d8e87-903a-489f-9587-4ee8d6fdce86 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:33.417124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:33.417825 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:33.430280 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:33.431164 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:33.433867 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:33.435035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:33.435902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:33.436520 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:33.468028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-db5d8e87-903a-489f-9587-4ee8d6fdce86 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:33.480576 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-db5d8e87-903a-489f-9587-4ee8d6fdce86 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1288 microversion: 2.1 time: 0.122608 Oct 14 17:55:33.481825 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 26/53] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:33 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1288 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:33.526284 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:33.536768 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:33.545526 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:33.546965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3df3f98d-2b1e-450d-bbcb-f29d64903019 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.134466 Oct 14 17:55:33.558389 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 28/54] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:33 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:33.895414 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3a8673e3-1178-434e-ba10-63ac06a1bc08 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:33.896331 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3a8673e3-1178-434e-ba10-63ac06a1bc08 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:33.916648 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3a8673e3-1178-434e-ba10-63ac06a1bc08 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:33.918515 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3a8673e3-1178-434e-ba10-63ac06a1bc08 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:33.920372 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3a8673e3-1178-434e-ba10-63ac06a1bc08 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:33.921334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3a8673e3-1178-434e-ba10-63ac06a1bc08 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:33.922166 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3a8673e3-1178-434e-ba10-63ac06a1bc08 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:33.923116 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3a8673e3-1178-434e-ba10-63ac06a1bc08 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:34.017504 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3a8673e3-1178-434e-ba10-63ac06a1bc08 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:34.026413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3a8673e3-1178-434e-ba10-63ac06a1bc08 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.135439 Oct 14 17:55:34.041173 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 27/55] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:33 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:34.266466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c285366c-b254-4ae6-950d-915c65c77c7a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:34.267069 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c285366c-b254-4ae6-950d-915c65c77c7a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:34.272449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=22 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:34.274626 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c285366c-b254-4ae6-950d-915c65c77c7a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:34.275119 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c285366c-b254-4ae6-950d-915c65c77c7a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:34.275547 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c285366c-b254-4ae6-950d-915c65c77c7a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:34.276292 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c285366c-b254-4ae6-950d-915c65c77c7a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:34.277003 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c285366c-b254-4ae6-950d-915c65c77c7a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:34.277572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c285366c-b254-4ae6-950d-915c65c77c7a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:34.504944 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-eb061fd0-093c-4093-bd8a-fd3e654ac44a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:34.506249 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-eb061fd0-093c-4093-bd8a-fd3e654ac44a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:34.519452 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb061fd0-093c-4093-bd8a-fd3e654ac44a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:34.520503 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c285366c-b254-4ae6-950d-915c65c77c7a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:34.521013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb061fd0-093c-4093-bd8a-fd3e654ac44a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:34.521595 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb061fd0-093c-4093-bd8a-fd3e654ac44a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:34.522505 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb061fd0-093c-4093-bd8a-fd3e654ac44a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:34.523106 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb061fd0-093c-4093-bd8a-fd3e654ac44a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:34.524363 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb061fd0-093c-4093-bd8a-fd3e654ac44a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:34.537067 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c285366c-b254-4ae6-950d-915c65c77c7a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.274264 Oct 14 17:55:34.542916 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 29/56] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:34 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:34.573304 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:34.574062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:34.580834 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:34.582569 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:34.583271 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:34.583993 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:34.584934 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:34.585588 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:34.587050 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:34.640361 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-eb061fd0-093c-4093-bd8a-fd3e654ac44a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:34.654637 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-eb061fd0-093c-4093-bd8a-fd3e654ac44a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1288 microversion: 2.1 time: 0.153360 Oct 14 17:55:34.655392 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 28/57] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:34 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1288 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:55:34.700165 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:34.712515 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:34.713974 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:34.715072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8b61699f-0b51-4928-b05b-f94d0198248c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.146790 Oct 14 17:55:34.715621 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 30/58] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:34 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:35.051595 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a15f6382-031c-4ca4-a775-3e8d2a63f445 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:35.052440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a15f6382-031c-4ca4-a775-3e8d2a63f445 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:35.059050 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a15f6382-031c-4ca4-a775-3e8d2a63f445 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:35.059527 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a15f6382-031c-4ca4-a775-3e8d2a63f445 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:35.070395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a15f6382-031c-4ca4-a775-3e8d2a63f445 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:35.071358 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a15f6382-031c-4ca4-a775-3e8d2a63f445 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:35.071836 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a15f6382-031c-4ca4-a775-3e8d2a63f445 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:35.072290 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a15f6382-031c-4ca4-a775-3e8d2a63f445 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:35.140547 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a15f6382-031c-4ca4-a775-3e8d2a63f445 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:35.148871 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a15f6382-031c-4ca4-a775-3e8d2a63f445 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.100955 Oct 14 17:55:35.149517 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:35 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:35.570047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1e3ba2ad-de85-4b70-bfb4-441d3d686eef tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:35.577420 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1e3ba2ad-de85-4b70-bfb4-441d3d686eef tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:35.583756 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1e3ba2ad-de85-4b70-bfb4-441d3d686eef tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:35.584589 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1e3ba2ad-de85-4b70-bfb4-441d3d686eef tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:35.585236 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1e3ba2ad-de85-4b70-bfb4-441d3d686eef tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:35.586741 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1e3ba2ad-de85-4b70-bfb4-441d3d686eef tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:35.588185 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1e3ba2ad-de85-4b70-bfb4-441d3d686eef tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:35.588846 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1e3ba2ad-de85-4b70-bfb4-441d3d686eef tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:35.684439 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2b6f2e7a-35c1-431a-9365-9f8b1eb2b90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:35.685043 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2b6f2e7a-35c1-431a-9365-9f8b1eb2b90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:35.691624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2b6f2e7a-35c1-431a-9365-9f8b1eb2b90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:35.692236 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2b6f2e7a-35c1-431a-9365-9f8b1eb2b90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:35.692563 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2b6f2e7a-35c1-431a-9365-9f8b1eb2b90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:35.693246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2b6f2e7a-35c1-431a-9365-9f8b1eb2b90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:35.693688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2b6f2e7a-35c1-431a-9365-9f8b1eb2b90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:35.694098 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2b6f2e7a-35c1-431a-9365-9f8b1eb2b90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:35.803399 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1e3ba2ad-de85-4b70-bfb4-441d3d686eef tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:35.814372 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1e3ba2ad-de85-4b70-bfb4-441d3d686eef tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.250514 Oct 14 17:55:35.815451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 31/60] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:35 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:35.828541 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2b6f2e7a-35c1-431a-9365-9f8b1eb2b90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:35.837272 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2b6f2e7a-35c1-431a-9365-9f8b1eb2b90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1288 microversion: 2.1 time: 0.156734 Oct 14 17:55:35.838466 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 30/61] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:35 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1288 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:35.846879 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:35.854200 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:35.864899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:35.865390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:35.865823 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:35.866655 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:35.867344 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:35.868071 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:35.955763 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:35.965671 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:35.967133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:35.968959 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-5a99cbcc-69ec-433c-bf94-9a74a4549b8c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.151594 Oct 14 17:55:35.969612 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:35 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:36.174926 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0cf13fff-8651-4726-a54f-97ce81b6b894 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:36.176041 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0cf13fff-8651-4726-a54f-97ce81b6b894 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:36.185967 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0cf13fff-8651-4726-a54f-97ce81b6b894 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:36.186823 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0cf13fff-8651-4726-a54f-97ce81b6b894 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:36.187473 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0cf13fff-8651-4726-a54f-97ce81b6b894 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:36.188896 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0cf13fff-8651-4726-a54f-97ce81b6b894 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:36.189595 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0cf13fff-8651-4726-a54f-97ce81b6b894 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:36.190194 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0cf13fff-8651-4726-a54f-97ce81b6b894 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:36.253951 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0cf13fff-8651-4726-a54f-97ce81b6b894 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:36.262476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0cf13fff-8651-4726-a54f-97ce81b6b894 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.092779 Oct 14 17:55:36.263164 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 31/63] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:36 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:36.840754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-883c864e-92cb-427a-bdb4-150e8b27c47b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:36.841364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-883c864e-92cb-427a-bdb4-150e8b27c47b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:36.847762 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-883c864e-92cb-427a-bdb4-150e8b27c47b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:36.848282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-883c864e-92cb-427a-bdb4-150e8b27c47b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:36.848891 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-883c864e-92cb-427a-bdb4-150e8b27c47b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:36.849586 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-883c864e-92cb-427a-bdb4-150e8b27c47b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:36.850028 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-883c864e-92cb-427a-bdb4-150e8b27c47b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:36.850588 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-883c864e-92cb-427a-bdb4-150e8b27c47b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:36.865337 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e58a95d3-2483-4e1b-ada5-8ae5ef6b0422 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:36.866560 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e58a95d3-2483-4e1b-ada5-8ae5ef6b0422 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:36.879016 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e58a95d3-2483-4e1b-ada5-8ae5ef6b0422 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:36.879766 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e58a95d3-2483-4e1b-ada5-8ae5ef6b0422 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:36.880545 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e58a95d3-2483-4e1b-ada5-8ae5ef6b0422 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:36.881401 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e58a95d3-2483-4e1b-ada5-8ae5ef6b0422 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:36.881989 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e58a95d3-2483-4e1b-ada5-8ae5ef6b0422 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:36.882560 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e58a95d3-2483-4e1b-ada5-8ae5ef6b0422 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:37.001855 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e58a95d3-2483-4e1b-ada5-8ae5ef6b0422 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:37.011012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e58a95d3-2483-4e1b-ada5-8ae5ef6b0422 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1288 microversion: 2.1 time: 0.149964 Oct 14 17:55:37.011850 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 32/64] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:36 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1288 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:37.016918 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:37.017520 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:37.023695 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:37.024435 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:37.025017 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:37.025875 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:37.026634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:37.027204 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:37.070825 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-883c864e-92cb-427a-bdb4-150e8b27c47b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:37.080120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-883c864e-92cb-427a-bdb4-150e8b27c47b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.245394 Oct 14 17:55:37.080706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 33/65] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:36 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:37.132688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:37.145156 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:37.146799 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:37.148001 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a51f3e55-c2f5-41d6-827d-56d45aeb7715 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.134974 Oct 14 17:55:37.149027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 33/66] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:37 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:37.289995 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-75906a32-68bc-444d-8652-82667a66052a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:37.290768 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-75906a32-68bc-444d-8652-82667a66052a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:37.298514 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75906a32-68bc-444d-8652-82667a66052a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:37.299172 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75906a32-68bc-444d-8652-82667a66052a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:37.299613 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75906a32-68bc-444d-8652-82667a66052a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:37.300781 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75906a32-68bc-444d-8652-82667a66052a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:37.301391 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75906a32-68bc-444d-8652-82667a66052a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:37.302022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75906a32-68bc-444d-8652-82667a66052a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:37.384071 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-75906a32-68bc-444d-8652-82667a66052a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:37.416402 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-75906a32-68bc-444d-8652-82667a66052a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.130705 Oct 14 17:55:37.417439 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 34/67] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:37 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:38.043059 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-eeb83125-5cb7-43b1-814c-a3f82320ca16 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:38.044495 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-eeb83125-5cb7-43b1-814c-a3f82320ca16 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:38.054219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eeb83125-5cb7-43b1-814c-a3f82320ca16 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:38.055369 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eeb83125-5cb7-43b1-814c-a3f82320ca16 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:38.056135 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eeb83125-5cb7-43b1-814c-a3f82320ca16 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:38.061219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eeb83125-5cb7-43b1-814c-a3f82320ca16 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:38.062251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eeb83125-5cb7-43b1-814c-a3f82320ca16 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:38.062941 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eeb83125-5cb7-43b1-814c-a3f82320ca16 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:38.112945 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-dc8545ef-71ec-4cb1-9aad-cb15b74725e0 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:38.113659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-dc8545ef-71ec-4cb1-9aad-cb15b74725e0 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:38.131739 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dc8545ef-71ec-4cb1-9aad-cb15b74725e0 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:38.132605 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dc8545ef-71ec-4cb1-9aad-cb15b74725e0 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:38.133599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dc8545ef-71ec-4cb1-9aad-cb15b74725e0 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:38.137284 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dc8545ef-71ec-4cb1-9aad-cb15b74725e0 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:38.137991 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dc8545ef-71ec-4cb1-9aad-cb15b74725e0 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:38.138663 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dc8545ef-71ec-4cb1-9aad-cb15b74725e0 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:38.156959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-eeb83125-5cb7-43b1-814c-a3f82320ca16 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:38.168720 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-eeb83125-5cb7-43b1-814c-a3f82320ca16 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1288 microversion: 2.1 time: 0.134614 Oct 14 17:55:38.170434 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 34/68] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:38 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1288 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:38.181358 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:38.182542 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:38.192135 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:38.193575 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:38.194279 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:38.195488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:38.197018 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:38.197803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:38.479897 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:38.495918 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:38.499236 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:38.505412 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b7dba1be-a02b-4c45-a0b5-78cee448c126 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.333668 Oct 14 17:55:38.506736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 35/69] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:38 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:38.512896 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e3c68c89-875e-490b-a764-1e37163bdd9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:38.516207 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e3c68c89-875e-490b-a764-1e37163bdd9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:38.533711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3c68c89-875e-490b-a764-1e37163bdd9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:38.535602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3c68c89-875e-490b-a764-1e37163bdd9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:38.536391 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3c68c89-875e-490b-a764-1e37163bdd9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:38.538635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3c68c89-875e-490b-a764-1e37163bdd9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:38.539352 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3c68c89-875e-490b-a764-1e37163bdd9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:38.541128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3c68c89-875e-490b-a764-1e37163bdd9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:38.632156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-dc8545ef-71ec-4cb1-9aad-cb15b74725e0 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:38.641797 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-dc8545ef-71ec-4cb1-9aad-cb15b74725e0 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.532741 Oct 14 17:55:38.669391 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 35/70] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:38 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:55:38.688717 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e3c68c89-875e-490b-a764-1e37163bdd9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:38.700781 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e3c68c89-875e-490b-a764-1e37163bdd9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.192645 Oct 14 17:55:38.702154 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 36/71] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:38 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:39.202330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-cdfd467f-9c79-4043-8ff3-4bd34b290fba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:39.203722 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-cdfd467f-9c79-4043-8ff3-4bd34b290fba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:39.209912 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cdfd467f-9c79-4043-8ff3-4bd34b290fba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:39.211170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cdfd467f-9c79-4043-8ff3-4bd34b290fba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:39.212642 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cdfd467f-9c79-4043-8ff3-4bd34b290fba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:39.217057 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cdfd467f-9c79-4043-8ff3-4bd34b290fba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:39.217790 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cdfd467f-9c79-4043-8ff3-4bd34b290fba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:39.218414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cdfd467f-9c79-4043-8ff3-4bd34b290fba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:39.312315 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-cdfd467f-9c79-4043-8ff3-4bd34b290fba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:39.321308 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-cdfd467f-9c79-4043-8ff3-4bd34b290fba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1288 microversion: 2.1 time: 0.122031 Oct 14 17:55:39.323629 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 36/72] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:39 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1288 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:39.536519 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:39.537126 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:39.545039 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:39.545913 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:39.547339 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:39.548488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:39.549219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:39.549909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:39.666475 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:39.676095 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:39.679042 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-410db521-0304-4874-adf3-f25db2f74bf6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:39.680230 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-410db521-0304-4874-adf3-f25db2f74bf6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:39.682173 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:39.685267 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9b21e80d-b829-43da-b828-c5023dbf9b6b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.153143 Oct 14 17:55:39.687666 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 37/73] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:39 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:39.699849 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-410db521-0304-4874-adf3-f25db2f74bf6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:39.701237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-410db521-0304-4874-adf3-f25db2f74bf6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:39.702352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-410db521-0304-4874-adf3-f25db2f74bf6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:39.704323 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-410db521-0304-4874-adf3-f25db2f74bf6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:39.705375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-410db521-0304-4874-adf3-f25db2f74bf6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:39.707008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-410db521-0304-4874-adf3-f25db2f74bf6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:39.726533 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-828dc36a-d6cf-4f35-a386-e14177bf1cb9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:39.731311 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-828dc36a-d6cf-4f35-a386-e14177bf1cb9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:39.743919 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-828dc36a-d6cf-4f35-a386-e14177bf1cb9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:39.744014 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-828dc36a-d6cf-4f35-a386-e14177bf1cb9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:39.744652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-828dc36a-d6cf-4f35-a386-e14177bf1cb9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:39.745701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-828dc36a-d6cf-4f35-a386-e14177bf1cb9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:39.746371 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-828dc36a-d6cf-4f35-a386-e14177bf1cb9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:39.747372 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-828dc36a-d6cf-4f35-a386-e14177bf1cb9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:39.877583 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-828dc36a-d6cf-4f35-a386-e14177bf1cb9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:39.897817 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-828dc36a-d6cf-4f35-a386-e14177bf1cb9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.173541 Oct 14 17:55:39.899357 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 38/74] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:39 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:40.115614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-410db521-0304-4874-adf3-f25db2f74bf6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:40.130950 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-410db521-0304-4874-adf3-f25db2f74bf6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.455811 Oct 14 17:55:40.145241 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 37/75] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:39 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:40.346925 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7cc17d45-1635-4a79-a3aa-aaa4c7b2baf4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:40.348374 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7cc17d45-1635-4a79-a3aa-aaa4c7b2baf4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:40.358715 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7cc17d45-1635-4a79-a3aa-aaa4c7b2baf4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:40.359842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7cc17d45-1635-4a79-a3aa-aaa4c7b2baf4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:40.360566 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7cc17d45-1635-4a79-a3aa-aaa4c7b2baf4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:40.361698 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7cc17d45-1635-4a79-a3aa-aaa4c7b2baf4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:40.362480 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7cc17d45-1635-4a79-a3aa-aaa4c7b2baf4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:40.363107 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7cc17d45-1635-4a79-a3aa-aaa4c7b2baf4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:40.487390 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7cc17d45-1635-4a79-a3aa-aaa4c7b2baf4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:40.498523 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7cc17d45-1635-4a79-a3aa-aaa4c7b2baf4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1288 microversion: 2.1 time: 0.155824 Oct 14 17:55:40.499173 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 39/76] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:40 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1288 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:40.721337 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:40.722241 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:40.739350 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:40.740102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:40.740928 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:40.742155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:40.744863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:40.745778 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:40.839472 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:40.845768 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:40.847286 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:40.850770 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b6e996eb-4e45-4b52-8677-c6c4110ef321 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1277 microversion: 2.20 time: 0.132038 Oct 14 17:55:40.850770 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 38/77] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:40 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:40.929681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-89b130cf-a46d-4da2-8328-41cc6dc47297 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:40.931931 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-89b130cf-a46d-4da2-8328-41cc6dc47297 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:40.938867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b130cf-a46d-4da2-8328-41cc6dc47297 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:40.939349 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b130cf-a46d-4da2-8328-41cc6dc47297 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:40.939773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b130cf-a46d-4da2-8328-41cc6dc47297 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:40.940589 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b130cf-a46d-4da2-8328-41cc6dc47297 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:40.941038 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b130cf-a46d-4da2-8328-41cc6dc47297 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:40.941805 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b130cf-a46d-4da2-8328-41cc6dc47297 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:41.052543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-89b130cf-a46d-4da2-8328-41cc6dc47297 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:41.067356 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-89b130cf-a46d-4da2-8328-41cc6dc47297 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.141277 Oct 14 17:55:41.069666 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 40/78] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:40 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:41.176265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-23b55311-b721-46f6-9ffd-fe717af17ce1 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:41.177022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-23b55311-b721-46f6-9ffd-fe717af17ce1 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:41.191180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-23b55311-b721-46f6-9ffd-fe717af17ce1 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:41.194500 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-23b55311-b721-46f6-9ffd-fe717af17ce1 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:41.196911 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-23b55311-b721-46f6-9ffd-fe717af17ce1 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:41.200327 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-23b55311-b721-46f6-9ffd-fe717af17ce1 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:41.203178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-23b55311-b721-46f6-9ffd-fe717af17ce1 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:41.204844 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-23b55311-b721-46f6-9ffd-fe717af17ce1 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:41.524351 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b1971f36-3bfb-4424-8f4f-59b200c5e200 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:41.525195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b1971f36-3bfb-4424-8f4f-59b200c5e200 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:41.537569 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b1971f36-3bfb-4424-8f4f-59b200c5e200 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:41.538309 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b1971f36-3bfb-4424-8f4f-59b200c5e200 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:41.539812 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b1971f36-3bfb-4424-8f4f-59b200c5e200 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:41.542669 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b1971f36-3bfb-4424-8f4f-59b200c5e200 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:41.543519 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b1971f36-3bfb-4424-8f4f-59b200c5e200 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:41.544097 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b1971f36-3bfb-4424-8f4f-59b200c5e200 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:41.843222 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b1971f36-3bfb-4424-8f4f-59b200c5e200 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:41.851479 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b1971f36-3bfb-4424-8f4f-59b200c5e200 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1306 microversion: 2.1 time: 0.332715 Oct 14 17:55:41.854900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 41/79] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:41 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1306 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:55:41.873648 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:41.874337 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:41.881960 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:41.882991 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:41.884618 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:41.885692 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:41.887430 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:41.890742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:41.899515 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=100 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:42.044256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-23b55311-b721-46f6-9ffd-fe717af17ce1 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:42.058473 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-23b55311-b721-46f6-9ffd-fe717af17ce1 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.886113 Oct 14 17:55:42.059394 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 39/80] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:41 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:42.092166 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-18b6615a-7655-4028-b6b1-8969efff16d7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:42.093218 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-18b6615a-7655-4028-b6b1-8969efff16d7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:42.111414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b6615a-7655-4028-b6b1-8969efff16d7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:42.112388 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b6615a-7655-4028-b6b1-8969efff16d7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:42.112976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b6615a-7655-4028-b6b1-8969efff16d7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:42.113844 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b6615a-7655-4028-b6b1-8969efff16d7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:42.114901 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b6615a-7655-4028-b6b1-8969efff16d7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:42.115755 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b6615a-7655-4028-b6b1-8969efff16d7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:42.124525 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:42.152789 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:42.154612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:42.155799 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ba9f26f5-7660-4770-8d63-111c86a0135d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1333 microversion: 2.20 time: 0.286055 Oct 14 17:55:42.160407 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 42/81] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:41 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1333 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:42.469188 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-18b6615a-7655-4028-b6b1-8969efff16d7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:42.485826 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-18b6615a-7655-4028-b6b1-8969efff16d7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1280 microversion: 2.1 time: 0.396981 Oct 14 17:55:42.487985 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 40/82] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:42 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1280 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:42.878482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-42f57651-786e-43fe-a03b-f72d96042434 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:42.879092 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-42f57651-786e-43fe-a03b-f72d96042434 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:42.885573 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42f57651-786e-43fe-a03b-f72d96042434 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:42.886321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42f57651-786e-43fe-a03b-f72d96042434 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:42.886924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42f57651-786e-43fe-a03b-f72d96042434 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:42.887778 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42f57651-786e-43fe-a03b-f72d96042434 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:42.888256 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42f57651-786e-43fe-a03b-f72d96042434 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:42.888684 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42f57651-786e-43fe-a03b-f72d96042434 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:43.047862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-42f57651-786e-43fe-a03b-f72d96042434 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:43.066732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-42f57651-786e-43fe-a03b-f72d96042434 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1294 microversion: 2.1 time: 0.191592 Oct 14 17:55:43.081343 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 43/83] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:42 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1294 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:43.090996 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-705d1c76-5bd0-4b01-add4-94ab7587aee3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:43.091995 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-705d1c76-5bd0-4b01-add4-94ab7587aee3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:43.101254 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-705d1c76-5bd0-4b01-add4-94ab7587aee3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:43.101779 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-705d1c76-5bd0-4b01-add4-94ab7587aee3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:43.102347 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-705d1c76-5bd0-4b01-add4-94ab7587aee3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:43.104519 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-705d1c76-5bd0-4b01-add4-94ab7587aee3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:43.105026 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-705d1c76-5bd0-4b01-add4-94ab7587aee3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:43.106909 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-705d1c76-5bd0-4b01-add4-94ab7587aee3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:43.201359 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:43.202907 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:43.218054 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:43.220130 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:43.222885 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:43.223907 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:43.224757 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:43.225446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:43.397563 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:43.418541 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:43.420392 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:43.426413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ba3d2734-817c-4a31-af8c-183db122a35f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1339 microversion: 2.20 time: 0.239476 Oct 14 17:55:43.427387 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 44/84] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:43 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1339 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:43.514217 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ab809cae-cedc-4a94-a6ee-584e11444858 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:43.515330 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ab809cae-cedc-4a94-a6ee-584e11444858 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:43.522478 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab809cae-cedc-4a94-a6ee-584e11444858 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:43.523246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab809cae-cedc-4a94-a6ee-584e11444858 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:43.523967 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab809cae-cedc-4a94-a6ee-584e11444858 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:43.525110 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab809cae-cedc-4a94-a6ee-584e11444858 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:43.525568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab809cae-cedc-4a94-a6ee-584e11444858 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:43.525986 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab809cae-cedc-4a94-a6ee-584e11444858 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:43.663706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-705d1c76-5bd0-4b01-add4-94ab7587aee3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:43.678278 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-705d1c76-5bd0-4b01-add4-94ab7587aee3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.595471 Oct 14 17:55:43.679821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 41/85] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:43 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:44.096339 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0723259e-4b54-488e-9aac-61aadd680392 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:44.097732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0723259e-4b54-488e-9aac-61aadd680392 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:44.118135 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0723259e-4b54-488e-9aac-61aadd680392 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:44.121455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0723259e-4b54-488e-9aac-61aadd680392 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:44.123388 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0723259e-4b54-488e-9aac-61aadd680392 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:44.125035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0723259e-4b54-488e-9aac-61aadd680392 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:44.127378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0723259e-4b54-488e-9aac-61aadd680392 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:44.129479 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0723259e-4b54-488e-9aac-61aadd680392 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:44.164248 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=100 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:44.420617 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ab809cae-cedc-4a94-a6ee-584e11444858 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:44.428272 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ab809cae-cedc-4a94-a6ee-584e11444858 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1322 microversion: 2.1 time: 0.918527 Oct 14 17:55:44.428838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 45/86] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:43 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1322 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:44.465047 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:44.466010 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:44.472584 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:44.473303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:44.473897 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:44.479957 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:44.480613 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:44.481182 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:44.526871 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0723259e-4b54-488e-9aac-61aadd680392 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:44.571303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0723259e-4b54-488e-9aac-61aadd680392 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1294 microversion: 2.1 time: 0.477062 Oct 14 17:55:44.574168 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 42/87] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:44 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1294 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:44.613528 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:44.635337 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:44.637055 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:44.643331 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e9edfeee-494d-464a-91f3-7f9913dc1011 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1339 microversion: 2.20 time: 0.193406 Oct 14 17:55:44.644148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 46/88] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:44 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1339 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:44.706385 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-dd1236ab-8150-4517-a7d1-44932fc7667e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:44.707252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-dd1236ab-8150-4517-a7d1-44932fc7667e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:44.716527 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd1236ab-8150-4517-a7d1-44932fc7667e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:44.717035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd1236ab-8150-4517-a7d1-44932fc7667e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:44.717466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd1236ab-8150-4517-a7d1-44932fc7667e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:44.718158 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd1236ab-8150-4517-a7d1-44932fc7667e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:44.718598 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd1236ab-8150-4517-a7d1-44932fc7667e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:44.719015 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd1236ab-8150-4517-a7d1-44932fc7667e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:45.440247 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-8c3177f8-0c64-45ea-af94-e612c55ddf24 req-81e63fb2-3055-4b3f-8abe-0ba40c73ae12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f20c98-c68a-4dbb-8f8b-0506c63f5d6a", "tag": "5c0c93a0-251d-455a-ae8a-79932ce54280"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:45.442206 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-dd1236ab-8150-4517-a7d1-44932fc7667e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:45.462529 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-dd1236ab-8150-4517-a7d1-44932fc7667e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.761425 Oct 14 17:55:45.463043 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 43/89] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:44 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:45.470647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-8c3177f8-0c64-45ea-af94-e612c55ddf24 req-81e63fb2-3055-4b3f-8abe-0ba40c73ae12 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:45.472803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-8c3177f8-0c64-45ea-af94-e612c55ddf24 req-81e63fb2-3055-4b3f-8abe-0ba40c73ae12 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:45.473460 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-8c3177f8-0c64-45ea-af94-e612c55ddf24 req-81e63fb2-3055-4b3f-8abe-0ba40c73ae12 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:45.477211 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2721e758-2b4e-44f0-bc27-2bd7589a68bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:45.477934 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2721e758-2b4e-44f0-bc27-2bd7589a68bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:45.510211 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-8c3177f8-0c64-45ea-af94-e612c55ddf24 req-81e63fb2-3055-4b3f-8abe-0ba40c73ae12 service nova] Creating event network-changed:5c0c93a0-251d-455a-ae8a-79932ce54280 for instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a on hv-cinder-74915 Oct 14 17:55:45.511446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-8c3177f8-0c64-45ea-af94-e612c55ddf24 req-81e63fb2-3055-4b3f-8abe-0ba40c73ae12 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118655) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 14 17:55:45.512079 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-8c3177f8-0c64-45ea-af94-e612c55ddf24 req-81e63fb2-3055-4b3f-8abe-0ba40c73ae12 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118655) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 14 17:55:45.514093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc8a9fa2-7497-4f8b-b50d-498f52dd6a6e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:45.514866 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc8a9fa2-7497-4f8b-b50d-498f52dd6a6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:45.515489 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc8a9fa2-7497-4f8b-b50d-498f52dd6a6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:45.516562 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc8a9fa2-7497-4f8b-b50d-498f52dd6a6e None None] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:45.517277 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc8a9fa2-7497-4f8b-b50d-498f52dd6a6e None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:45.518108 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc8a9fa2-7497-4f8b-b50d-498f52dd6a6e None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:45.522915 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2721e758-2b4e-44f0-bc27-2bd7589a68bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:45.525824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2721e758-2b4e-44f0-bc27-2bd7589a68bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:45.526512 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2721e758-2b4e-44f0-bc27-2bd7589a68bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:45.527468 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2721e758-2b4e-44f0-bc27-2bd7589a68bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:45.536860 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.compute.rpcapi [None req-fc8a9fa2-7497-4f8b-b50d-498f52dd6a6e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 14 17:55:45.537941 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc8a9fa2-7497-4f8b-b50d-498f52dd6a6e None None] Releasing lock "compute-rpcapi-router" {{(pid=118655) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 14 17:55:45.538053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2721e758-2b4e-44f0-bc27-2bd7589a68bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:45.547569 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2721e758-2b4e-44f0-bc27-2bd7589a68bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:45.560539 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-fc8a9fa2-7497-4f8b-b50d-498f52dd6a6e None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.443810 Oct 14 17:55:45.562129 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 47/90] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:45.596882 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-523111bd-6989-4079-a6f9-db697f6ccd75 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:45.597764 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-523111bd-6989-4079-a6f9-db697f6ccd75 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:45.606989 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-523111bd-6989-4079-a6f9-db697f6ccd75 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:45.607465 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-523111bd-6989-4079-a6f9-db697f6ccd75 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:45.607926 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-523111bd-6989-4079-a6f9-db697f6ccd75 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:45.608602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-523111bd-6989-4079-a6f9-db697f6ccd75 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:45.609111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-523111bd-6989-4079-a6f9-db697f6ccd75 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:45.615484 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-523111bd-6989-4079-a6f9-db697f6ccd75 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:46.191927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2721e758-2b4e-44f0-bc27-2bd7589a68bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:46.213919 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2721e758-2b4e-44f0-bc27-2bd7589a68bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1322 microversion: 2.1 time: 0.740667 Oct 14 17:55:46.220374 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 44/91] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:45 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1322 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:46.230859 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:46.232677 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:46.239721 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:46.244181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:46.244181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:46.244181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:46.244181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:46.244604 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:46.245364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-523111bd-6989-4079-a6f9-db697f6ccd75 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:46.256581 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-523111bd-6989-4079-a6f9-db697f6ccd75 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.664404 Oct 14 17:55:46.258057 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 48/92] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:45 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:55:46.490657 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-402110cb-dccf-42a6-876f-bc880af11621 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:46.491461 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-402110cb-dccf-42a6-876f-bc880af11621 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:46.505277 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-402110cb-dccf-42a6-876f-bc880af11621 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:46.505823 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-402110cb-dccf-42a6-876f-bc880af11621 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:46.507730 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-402110cb-dccf-42a6-876f-bc880af11621 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:46.511585 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-402110cb-dccf-42a6-876f-bc880af11621 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:46.512905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-402110cb-dccf-42a6-876f-bc880af11621 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:46.515584 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-402110cb-dccf-42a6-876f-bc880af11621 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:47.067005 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:47.082977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:47.087416 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:47.090890 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a84aa882-9b90-4c50-afc2-4f7942544878 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.867403 Oct 14 17:55:47.093020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 45/93] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:46 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:47.194203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-402110cb-dccf-42a6-876f-bc880af11621 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:47.206646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-402110cb-dccf-42a6-876f-bc880af11621 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.720515 Oct 14 17:55:47.207226 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 49/94] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:46 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:55:47.238779 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-da07a69f-9756-4c2a-8b75-2c8953702c7c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:47.239455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-da07a69f-9756-4c2a-8b75-2c8953702c7c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:47.255529 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da07a69f-9756-4c2a-8b75-2c8953702c7c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:47.256199 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da07a69f-9756-4c2a-8b75-2c8953702c7c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:47.256795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da07a69f-9756-4c2a-8b75-2c8953702c7c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:47.257646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da07a69f-9756-4c2a-8b75-2c8953702c7c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:47.258262 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da07a69f-9756-4c2a-8b75-2c8953702c7c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:47.258828 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da07a69f-9756-4c2a-8b75-2c8953702c7c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:47.557896 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-4567da83-3e5e-4e88-abc6-01da61362182 req-87de4976-7795-45c1-b81d-1a53afad34cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6e1a11-3cfe-45f3-a0c2-47568e6c0020", "tag": "82b98b21-382e-49c9-82b3-d824f014d3ed"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:47.574888 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-4567da83-3e5e-4e88-abc6-01da61362182 req-87de4976-7795-45c1-b81d-1a53afad34cd service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:47.575761 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-4567da83-3e5e-4e88-abc6-01da61362182 req-87de4976-7795-45c1-b81d-1a53afad34cd service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:47.576434 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-4567da83-3e5e-4e88-abc6-01da61362182 req-87de4976-7795-45c1-b81d-1a53afad34cd service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:47.609664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-4567da83-3e5e-4e88-abc6-01da61362182 req-87de4976-7795-45c1-b81d-1a53afad34cd service nova] Creating event network-changed:82b98b21-382e-49c9-82b3-d824f014d3ed for instance 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 on hv-cinder-74915 Oct 14 17:55:47.610533 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-4567da83-3e5e-4e88-abc6-01da61362182 req-87de4976-7795-45c1-b81d-1a53afad34cd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118656) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 14 17:55:47.611155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-4567da83-3e5e-4e88-abc6-01da61362182 req-87de4976-7795-45c1-b81d-1a53afad34cd service nova] Acquired lock "compute-rpcapi-router" {{(pid=118656) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 14 17:55:47.612791 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd05380d-8473-4a39-99f1-af4b01a42f9d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:47.613451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd05380d-8473-4a39-99f1-af4b01a42f9d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:47.614224 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd05380d-8473-4a39-99f1-af4b01a42f9d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:47.615223 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd05380d-8473-4a39-99f1-af4b01a42f9d None None] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:47.615968 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd05380d-8473-4a39-99f1-af4b01a42f9d None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:47.616595 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd05380d-8473-4a39-99f1-af4b01a42f9d None None] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:47.629204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.compute.rpcapi [None req-dd05380d-8473-4a39-99f1-af4b01a42f9d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 14 17:55:47.630479 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd05380d-8473-4a39-99f1-af4b01a42f9d None None] Releasing lock "compute-rpcapi-router" {{(pid=118656) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 14 17:55:47.634329 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-da07a69f-9756-4c2a-8b75-2c8953702c7c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:47.654091 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-da07a69f-9756-4c2a-8b75-2c8953702c7c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1322 microversion: 2.1 time: 0.418972 Oct 14 17:55:47.654680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 50/95] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:47 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:55:47.669642 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-91ee9089-06bb-45fc-8646-f93c22ff58a7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:47.670574 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-91ee9089-06bb-45fc-8646-f93c22ff58a7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:47.675831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-dd05380d-8473-4a39-99f1-af4b01a42f9d None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.579569 Oct 14 17:55:47.676822 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 46/96] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:47.682743 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-61cfc172-94e8-41f6-b034-2979d411c04d req-7bacd17a-94ce-4e51-858f-3a2066d7a708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b519c690-9e51-4863-89b4-ee2a3a5d8846", "tag": "4fabe4d0-728b-4fc6-a568-02ede59f8a1d"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:47.684151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91ee9089-06bb-45fc-8646-f93c22ff58a7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:47.684738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91ee9089-06bb-45fc-8646-f93c22ff58a7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:47.685246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91ee9089-06bb-45fc-8646-f93c22ff58a7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:47.686031 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91ee9089-06bb-45fc-8646-f93c22ff58a7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:47.686556 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91ee9089-06bb-45fc-8646-f93c22ff58a7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:47.687096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91ee9089-06bb-45fc-8646-f93c22ff58a7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:47.692794 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-61cfc172-94e8-41f6-b034-2979d411c04d req-7bacd17a-94ce-4e51-858f-3a2066d7a708 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:47.693538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-61cfc172-94e8-41f6-b034-2979d411c04d req-7bacd17a-94ce-4e51-858f-3a2066d7a708 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:47.694758 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-61cfc172-94e8-41f6-b034-2979d411c04d req-7bacd17a-94ce-4e51-858f-3a2066d7a708 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:47.707682 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-61cfc172-94e8-41f6-b034-2979d411c04d req-7bacd17a-94ce-4e51-858f-3a2066d7a708 service nova] Creating event network-changed:4fabe4d0-728b-4fc6-a568-02ede59f8a1d for instance b519c690-9e51-4863-89b4-ee2a3a5d8846 on hv-cinder-74915 Oct 14 17:55:47.713338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-61cfc172-94e8-41f6-b034-2979d411c04d req-7bacd17a-94ce-4e51-858f-3a2066d7a708 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035187 Oct 14 17:55:47.720369 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 47/97] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:48.129171 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:48.129994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:48.147658 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:48.148180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:48.149179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:48.149899 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-91ee9089-06bb-45fc-8646-f93c22ff58a7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:48.155251 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:48.156708 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:48.157496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:48.165742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-91ee9089-06bb-45fc-8646-f93c22ff58a7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.499616 Oct 14 17:55:48.168772 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 51/98] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:47 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:48.231498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-fb7c2d39-8fca-4491-8100-70252739a6b3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:48.232491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-fb7c2d39-8fca-4491-8100-70252739a6b3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:48.242907 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb7c2d39-8fca-4491-8100-70252739a6b3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:48.250106 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb7c2d39-8fca-4491-8100-70252739a6b3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:48.253201 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb7c2d39-8fca-4491-8100-70252739a6b3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:48.256590 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb7c2d39-8fca-4491-8100-70252739a6b3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:48.258946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb7c2d39-8fca-4491-8100-70252739a6b3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:48.260934 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb7c2d39-8fca-4491-8100-70252739a6b3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:48.886557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:48.899573 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:48.901511 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:48.902634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d1cda994-abbe-4f8b-becb-736fea5f7476 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.784084 Oct 14 17:55:48.912856 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 48/99] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:48 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:48.915535 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a89075e7-0123-4cff-8011-85ed13161a34 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:48.918634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a89075e7-0123-4cff-8011-85ed13161a34 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:48.938581 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89075e7-0123-4cff-8011-85ed13161a34 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:48.939901 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89075e7-0123-4cff-8011-85ed13161a34 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:48.941360 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89075e7-0123-4cff-8011-85ed13161a34 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:48.942714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89075e7-0123-4cff-8011-85ed13161a34 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:48.945061 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89075e7-0123-4cff-8011-85ed13161a34 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:48.947700 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89075e7-0123-4cff-8011-85ed13161a34 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:48.968677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-fb7c2d39-8fca-4491-8100-70252739a6b3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:48.979320 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-fb7c2d39-8fca-4491-8100-70252739a6b3 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.752482 Oct 14 17:55:48.999845 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 52/100] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:48 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:55:49.196841 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-35c6b27d-e6cd-4f47-9604-cdad1ad226df tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:49.197451 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-35c6b27d-e6cd-4f47-9604-cdad1ad226df tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:49.209835 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-35c6b27d-e6cd-4f47-9604-cdad1ad226df tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:49.210329 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-35c6b27d-e6cd-4f47-9604-cdad1ad226df tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:49.210959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-35c6b27d-e6cd-4f47-9604-cdad1ad226df tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:49.211723 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-35c6b27d-e6cd-4f47-9604-cdad1ad226df tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:49.212210 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-35c6b27d-e6cd-4f47-9604-cdad1ad226df tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:49.212636 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-35c6b27d-e6cd-4f47-9604-cdad1ad226df tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:49.976036 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a89075e7-0123-4cff-8011-85ed13161a34 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:49.985355 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a89075e7-0123-4cff-8011-85ed13161a34 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1322 microversion: 2.1 time: 1.074890 Oct 14 17:55:49.990965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 49/101] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:48 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1322 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:50.009212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-65c05daa-a10f-4ad4-9041-44fe426b87d8 req-87425d2d-04a0-48d8-bcdc-62182f45e3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8dd3e30-1c69-471e-8b17-4205d267eb94", "tag": "26876ea9-63aa-403a-8423-dc062a217cc1"}, {"name": "network-changed", "server_uuid": "58c0a43e-1109-4ff9-9617-8a2958de7b0b", "tag": "04f9946a-535a-428e-8287-bac5d55cc781"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:50.027068 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-65c05daa-a10f-4ad4-9041-44fe426b87d8 req-87425d2d-04a0-48d8-bcdc-62182f45e3ec service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:50.029162 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-65c05daa-a10f-4ad4-9041-44fe426b87d8 req-87425d2d-04a0-48d8-bcdc-62182f45e3ec service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:50.029688 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-65c05daa-a10f-4ad4-9041-44fe426b87d8 req-87425d2d-04a0-48d8-bcdc-62182f45e3ec service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:50.059390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-65c05daa-a10f-4ad4-9041-44fe426b87d8 req-87425d2d-04a0-48d8-bcdc-62182f45e3ec service nova] Creating event network-changed:26876ea9-63aa-403a-8423-dc062a217cc1 for instance c8dd3e30-1c69-471e-8b17-4205d267eb94 on hv-cinder-74915 Oct 14 17:55:50.065707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-65c05daa-a10f-4ad4-9041-44fe426b87d8 req-87425d2d-04a0-48d8-bcdc-62182f45e3ec service nova] Creating event network-changed:04f9946a-535a-428e-8287-bac5d55cc781 for instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b on hv-cinder-74915 Oct 14 17:55:50.083557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-65c05daa-a10f-4ad4-9041-44fe426b87d8 req-87425d2d-04a0-48d8-bcdc-62182f45e3ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089712 Oct 14 17:55:50.085606 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 50/102] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:50.094343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:50.095421 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:50.103760 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:50.104756 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:50.105780 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:50.107165 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:50.107954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:50.109096 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:50.165401 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-35c6b27d-e6cd-4f47-9604-cdad1ad226df tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:50.173298 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-35c6b27d-e6cd-4f47-9604-cdad1ad226df tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.980285 Oct 14 17:55:50.173873 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 53/103] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:49 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:50.189174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-40dbda5f-4084-4fc1-8564-5b187ba98c90 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:50.190009 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-40dbda5f-4084-4fc1-8564-5b187ba98c90 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:50.203327 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-40dbda5f-4084-4fc1-8564-5b187ba98c90 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:50.204077 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-40dbda5f-4084-4fc1-8564-5b187ba98c90 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:50.204651 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-40dbda5f-4084-4fc1-8564-5b187ba98c90 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:50.205497 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-40dbda5f-4084-4fc1-8564-5b187ba98c90 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:50.206148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-40dbda5f-4084-4fc1-8564-5b187ba98c90 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:50.206715 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-40dbda5f-4084-4fc1-8564-5b187ba98c90 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:50.965641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:50.977746 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:50.980804 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:50.984745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-54d53e3f-1887-43e2-bcc1-8b92954e0579 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.894686 Oct 14 17:55:51.010668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-40dbda5f-4084-4fc1-8564-5b187ba98c90 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:51.020400 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 51/104] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:50 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:51.022453 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-40dbda5f-4084-4fc1-8564-5b187ba98c90 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.845447 Oct 14 17:55:51.024849 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 54/105] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:50 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:51.040257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a3b417d3-6e98-4000-882b-9781e8f230e1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:51.040257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a3b417d3-6e98-4000-882b-9781e8f230e1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:51.069723 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a3b417d3-6e98-4000-882b-9781e8f230e1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:51.072480 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a3b417d3-6e98-4000-882b-9781e8f230e1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:51.079919 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a3b417d3-6e98-4000-882b-9781e8f230e1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:51.081523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a3b417d3-6e98-4000-882b-9781e8f230e1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:51.081987 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a3b417d3-6e98-4000-882b-9781e8f230e1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:51.082416 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a3b417d3-6e98-4000-882b-9781e8f230e1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:51.202552 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-58aad107-bffc-4ee8-930e-71be97f828ac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:51.203613 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-58aad107-bffc-4ee8-930e-71be97f828ac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:51.219614 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-58aad107-bffc-4ee8-930e-71be97f828ac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:51.222104 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-58aad107-bffc-4ee8-930e-71be97f828ac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:51.223537 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-58aad107-bffc-4ee8-930e-71be97f828ac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:51.226560 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-58aad107-bffc-4ee8-930e-71be97f828ac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:51.229626 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-58aad107-bffc-4ee8-930e-71be97f828ac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:51.230263 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-58aad107-bffc-4ee8-930e-71be97f828ac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:51.487066 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-58aad107-bffc-4ee8-930e-71be97f828ac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:51.490850 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a3b417d3-6e98-4000-882b-9781e8f230e1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:51.501059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a3b417d3-6e98-4000-882b-9781e8f230e1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1322 microversion: 2.1 time: 0.479311 Oct 14 17:55:51.502318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-58aad107-bffc-4ee8-930e-71be97f828ac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.304673 Oct 14 17:55:51.504398 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 52/106] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:51 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:51.504768 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 55/107] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:51 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:55:51.663470 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-a973707a-c675-49d1-bf72-41b55c7ea1d1 req-566ff2e3-7a45-449c-ac1e-93def15c18bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f20c98-c68a-4dbb-8f8b-0506c63f5d6a", "name": "network-vif-plugged", "status": "completed", "tag": "5c0c93a0-251d-455a-ae8a-79932ce54280"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:51.673492 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-a973707a-c675-49d1-bf72-41b55c7ea1d1 req-566ff2e3-7a45-449c-ac1e-93def15c18bc service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:51.674259 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-a973707a-c675-49d1-bf72-41b55c7ea1d1 req-566ff2e3-7a45-449c-ac1e-93def15c18bc service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:51.674839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-a973707a-c675-49d1-bf72-41b55c7ea1d1 req-566ff2e3-7a45-449c-ac1e-93def15c18bc service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:51.687449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-a973707a-c675-49d1-bf72-41b55c7ea1d1 req-566ff2e3-7a45-449c-ac1e-93def15c18bc service nova] Creating event network-vif-plugged:5c0c93a0-251d-455a-ae8a-79932ce54280 for instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a on hv-cinder-74915 Oct 14 17:55:51.693269 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-a973707a-c675-49d1-bf72-41b55c7ea1d1 req-566ff2e3-7a45-449c-ac1e-93def15c18bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187320 Oct 14 17:55:51.694068 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 53/108] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:52.014061 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:52.014995 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:52.027982 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:52.028733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:52.029271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:52.031373 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:52.033374 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:52.034362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:52.049474 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-741b1b59-5695-443a-a3b6-8b53fd71647c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:52.050176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-741b1b59-5695-443a-a3b6-8b53fd71647c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:52.066530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-741b1b59-5695-443a-a3b6-8b53fd71647c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:52.075071 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-741b1b59-5695-443a-a3b6-8b53fd71647c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:52.075524 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-741b1b59-5695-443a-a3b6-8b53fd71647c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:52.076285 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-741b1b59-5695-443a-a3b6-8b53fd71647c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:52.077354 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-741b1b59-5695-443a-a3b6-8b53fd71647c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:52.077966 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-741b1b59-5695-443a-a3b6-8b53fd71647c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:52.731978 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-741b1b59-5695-443a-a3b6-8b53fd71647c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:52.739431 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-741b1b59-5695-443a-a3b6-8b53fd71647c tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.695579 Oct 14 17:55:52.745264 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 54/109] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:52 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:52.750193 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-61b48257-e9ca-4285-b01d-5f46d97c159a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:52.753159 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-61b48257-e9ca-4285-b01d-5f46d97c159a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:52.755000 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:52.761721 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61b48257-e9ca-4285-b01d-5f46d97c159a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:52.762432 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61b48257-e9ca-4285-b01d-5f46d97c159a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:52.763021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61b48257-e9ca-4285-b01d-5f46d97c159a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:52.764160 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61b48257-e9ca-4285-b01d-5f46d97c159a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:52.764875 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61b48257-e9ca-4285-b01d-5f46d97c159a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:52.765434 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61b48257-e9ca-4285-b01d-5f46d97c159a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:52.770129 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:52.779688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:52.781288 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3bdf9e24-2aee-48f2-8ec8-de42d5ae3ba0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.771734 Oct 14 17:55:52.782440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 56/110] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:52 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:52.792940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-51a2ff68-4f3a-4920-b185-5a7b0351a137 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:52.793564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-51a2ff68-4f3a-4920-b185-5a7b0351a137 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:52.808797 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-51a2ff68-4f3a-4920-b185-5a7b0351a137 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:52.809371 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-51a2ff68-4f3a-4920-b185-5a7b0351a137 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:52.810666 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-51a2ff68-4f3a-4920-b185-5a7b0351a137 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:52.815037 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-51a2ff68-4f3a-4920-b185-5a7b0351a137 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:52.817186 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-51a2ff68-4f3a-4920-b185-5a7b0351a137 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:52.817821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-51a2ff68-4f3a-4920-b185-5a7b0351a137 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:53.005935 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-61b48257-e9ca-4285-b01d-5f46d97c159a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:53.016303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-61b48257-e9ca-4285-b01d-5f46d97c159a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1322 microversion: 2.1 time: 0.269790 Oct 14 17:55:53.026298 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 55/111] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:52 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:53.079199 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-51a2ff68-4f3a-4920-b185-5a7b0351a137 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:53.089242 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-51a2ff68-4f3a-4920-b185-5a7b0351a137 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.305349 Oct 14 17:55:53.090216 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 57/112] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:52 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:53.712084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-8317aa5c-3b38-4042-8b51-b27aa5e23d33 req-43025a93-00a2-49d0-937e-48d222ac5f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b519c690-9e51-4863-89b4-ee2a3a5d8846", "name": "network-vif-plugged", "status": "completed", "tag": "4fabe4d0-728b-4fc6-a568-02ede59f8a1d"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:53.723072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-8317aa5c-3b38-4042-8b51-b27aa5e23d33 req-43025a93-00a2-49d0-937e-48d222ac5f9a service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:53.724071 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-8317aa5c-3b38-4042-8b51-b27aa5e23d33 req-43025a93-00a2-49d0-937e-48d222ac5f9a service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:53.724673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-8317aa5c-3b38-4042-8b51-b27aa5e23d33 req-43025a93-00a2-49d0-937e-48d222ac5f9a service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:53.739389 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-8317aa5c-3b38-4042-8b51-b27aa5e23d33 req-43025a93-00a2-49d0-937e-48d222ac5f9a service nova] Creating event network-vif-plugged:4fabe4d0-728b-4fc6-a568-02ede59f8a1d for instance b519c690-9e51-4863-89b4-ee2a3a5d8846 on hv-cinder-74915 Oct 14 17:55:53.749139 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-8317aa5c-3b38-4042-8b51-b27aa5e23d33 req-43025a93-00a2-49d0-937e-48d222ac5f9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040656 Oct 14 17:55:53.750247 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 56/113] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:53.772267 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-03def68c-33e6-4efb-a745-df10d6b09d39 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:53.773405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-03def68c-33e6-4efb-a745-df10d6b09d39 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:53.787200 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03def68c-33e6-4efb-a745-df10d6b09d39 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:53.787690 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03def68c-33e6-4efb-a745-df10d6b09d39 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:53.788145 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03def68c-33e6-4efb-a745-df10d6b09d39 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:53.788842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03def68c-33e6-4efb-a745-df10d6b09d39 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:53.789843 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03def68c-33e6-4efb-a745-df10d6b09d39 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:53.790261 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03def68c-33e6-4efb-a745-df10d6b09d39 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:53.814491 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:53.815609 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:53.824561 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:53.825303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:53.826038 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:53.827226 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:53.828023 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:53.828666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:54.065322 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:54.079494 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:54.082902 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-03def68c-33e6-4efb-a745-df10d6b09d39 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:54.085179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:54.086640 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7f2382bf-68cc-4eb0-98bf-5a0374c2a28f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.277462 Oct 14 17:55:54.100866 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 57/114] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:53 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:54.123586 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-03def68c-33e6-4efb-a745-df10d6b09d39 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.354924 Oct 14 17:55:54.126806 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 58/115] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:53 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:54.130161 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-dd07ef9b-953c-4eb4-b9f7-00e61a3d0a55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:54.130625 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-dd07ef9b-953c-4eb4-b9f7-00e61a3d0a55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:54.131586 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8e50d3bf-90f2-4820-bf73-a2a4b2c39a4c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:54.132220 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8e50d3bf-90f2-4820-bf73-a2a4b2c39a4c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:54.142081 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd07ef9b-953c-4eb4-b9f7-00e61a3d0a55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:54.145741 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd07ef9b-953c-4eb4-b9f7-00e61a3d0a55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:54.146400 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd07ef9b-953c-4eb4-b9f7-00e61a3d0a55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:54.148419 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd07ef9b-953c-4eb4-b9f7-00e61a3d0a55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:54.150798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd07ef9b-953c-4eb4-b9f7-00e61a3d0a55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:54.151366 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd07ef9b-953c-4eb4-b9f7-00e61a3d0a55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:54.159606 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8e50d3bf-90f2-4820-bf73-a2a4b2c39a4c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:54.160221 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8e50d3bf-90f2-4820-bf73-a2a4b2c39a4c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:54.160699 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8e50d3bf-90f2-4820-bf73-a2a4b2c39a4c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:54.161419 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8e50d3bf-90f2-4820-bf73-a2a4b2c39a4c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:54.171569 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8e50d3bf-90f2-4820-bf73-a2a4b2c39a4c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:54.173240 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8e50d3bf-90f2-4820-bf73-a2a4b2c39a4c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:54.180714 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=100 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:54.378288 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-dd07ef9b-953c-4eb4-b9f7-00e61a3d0a55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:54.394355 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-dd07ef9b-953c-4eb4-b9f7-00e61a3d0a55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1322 microversion: 2.1 time: 0.293559 Oct 14 17:55:54.396051 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 58/116] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:54 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:54.458625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8e50d3bf-90f2-4820-bf73-a2a4b2c39a4c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:54.468811 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8e50d3bf-90f2-4820-bf73-a2a4b2c39a4c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.340871 Oct 14 17:55:54.469933 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 59/117] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:54 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:55.115571 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:55.116947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:55.130630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:55.131308 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:55.134209 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:55.135113 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:55.135573 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:55.136209 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:55.152088 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e9ee09ed-bce2-4ea1-b29a-c0eebfe9563a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:55.152909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e9ee09ed-bce2-4ea1-b29a-c0eebfe9563a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:55.169984 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9ee09ed-bce2-4ea1-b29a-c0eebfe9563a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:55.172382 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9ee09ed-bce2-4ea1-b29a-c0eebfe9563a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:55.173382 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9ee09ed-bce2-4ea1-b29a-c0eebfe9563a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:55.175565 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9ee09ed-bce2-4ea1-b29a-c0eebfe9563a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:55.176175 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9ee09ed-bce2-4ea1-b29a-c0eebfe9563a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:55.177140 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e9ee09ed-bce2-4ea1-b29a-c0eebfe9563a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:55.534831 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:55.549132 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:55.567165 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e9ee09ed-bce2-4ea1-b29a-c0eebfe9563a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:55.599845 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:55.605002 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:55.609024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e9ee09ed-bce2-4ea1-b29a-c0eebfe9563a tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.463479 Oct 14 17:55:55.609671 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-46ba4084-5536-4e88-81c2-5354475fc396 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.495841 Oct 14 17:55:55.610851 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 59/118] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:55 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:55.614014 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 60/119] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:55 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:55.624809 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-57f23499-1da4-47b0-ad29-cb607521a883 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:55.625639 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-57f23499-1da4-47b0-ad29-cb607521a883 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:55.626086 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-90498da7-cbb3-4b32-a2ed-1c1f594971da tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:55.626914 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-90498da7-cbb3-4b32-a2ed-1c1f594971da tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:55.640720 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90498da7-cbb3-4b32-a2ed-1c1f594971da tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:55.642587 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57f23499-1da4-47b0-ad29-cb607521a883 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:55.643076 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57f23499-1da4-47b0-ad29-cb607521a883 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:55.643507 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57f23499-1da4-47b0-ad29-cb607521a883 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:55.644250 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57f23499-1da4-47b0-ad29-cb607521a883 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:55.644699 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57f23499-1da4-47b0-ad29-cb607521a883 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:55.645580 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90498da7-cbb3-4b32-a2ed-1c1f594971da tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:55.646006 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90498da7-cbb3-4b32-a2ed-1c1f594971da tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:55.646710 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90498da7-cbb3-4b32-a2ed-1c1f594971da tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:55.647148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90498da7-cbb3-4b32-a2ed-1c1f594971da tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:55.647803 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90498da7-cbb3-4b32-a2ed-1c1f594971da tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:55.648183 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57f23499-1da4-47b0-ad29-cb607521a883 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:56.016454 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-90498da7-cbb3-4b32-a2ed-1c1f594971da tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:56.028152 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-57f23499-1da4-47b0-ad29-cb607521a883 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:56.030140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-90498da7-cbb3-4b32-a2ed-1c1f594971da tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1322 microversion: 2.1 time: 0.415666 Oct 14 17:55:56.033134 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 60/120] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:55 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:56.042143 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-57f23499-1da4-47b0-ad29-cb607521a883 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.426383 Oct 14 17:55:56.043235 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 61/121] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:55 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:56.643393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:56.644248 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:56.646441 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8cae25b9-4858-47be-8018-6e2acabacf03 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:56.647088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8cae25b9-4858-47be-8018-6e2acabacf03 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:56.663976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cae25b9-4858-47be-8018-6e2acabacf03 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:56.665008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cae25b9-4858-47be-8018-6e2acabacf03 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:56.665535 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:56.666417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:56.667073 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cae25b9-4858-47be-8018-6e2acabacf03 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:56.667713 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:56.668679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cae25b9-4858-47be-8018-6e2acabacf03 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:56.669851 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:56.670563 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cae25b9-4858-47be-8018-6e2acabacf03 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:56.672019 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:56.672804 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cae25b9-4858-47be-8018-6e2acabacf03 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:56.673732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:56.942634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:56.956434 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8cae25b9-4858-47be-8018-6e2acabacf03 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:56.964001 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:56.965674 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:56.969115 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8cae25b9-4858-47be-8018-6e2acabacf03 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1315 microversion: 2.1 time: 0.335374 Oct 14 17:55:56.972050 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 61/122] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:56 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:56.978317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-99812352-62fd-413e-b39d-aecbfa8c9a61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.328872 Oct 14 17:55:56.978947 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 62/123] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:56 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:56.980449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-4282f91d-a942-48de-930d-7ace8c56f404 req-2396000c-3744-4a3c-9a66-18074b1fe4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6e1a11-3cfe-45f3-a0c2-47568e6c0020", "name": "network-vif-plugged", "status": "completed", "tag": "82b98b21-382e-49c9-82b3-d824f014d3ed"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:57.003703 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-4282f91d-a942-48de-930d-7ace8c56f404 req-2396000c-3744-4a3c-9a66-18074b1fe4bf service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:57.004150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-4282f91d-a942-48de-930d-7ace8c56f404 req-2396000c-3744-4a3c-9a66-18074b1fe4bf service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:57.004592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-4282f91d-a942-48de-930d-7ace8c56f404 req-2396000c-3744-4a3c-9a66-18074b1fe4bf service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:57.008924 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=100 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:57.017570 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-4282f91d-a942-48de-930d-7ace8c56f404 req-2396000c-3744-4a3c-9a66-18074b1fe4bf service nova] Creating event network-vif-plugged:82b98b21-382e-49c9-82b3-d824f014d3ed for instance 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 on hv-cinder-74915 Oct 14 17:55:57.023056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-4282f91d-a942-48de-930d-7ace8c56f404 req-2396000c-3744-4a3c-9a66-18074b1fe4bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049417 Oct 14 17:55:57.024597 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 62/124] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:57.055821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2a88e22d-1c47-4af3-9e13-0618b0b08054 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:57.056702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2a88e22d-1c47-4af3-9e13-0618b0b08054 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:57.065159 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a88e22d-1c47-4af3-9e13-0618b0b08054 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:57.065949 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a88e22d-1c47-4af3-9e13-0618b0b08054 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:57.066581 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a88e22d-1c47-4af3-9e13-0618b0b08054 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:57.067538 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a88e22d-1c47-4af3-9e13-0618b0b08054 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:57.068319 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a88e22d-1c47-4af3-9e13-0618b0b08054 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:57.069076 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a88e22d-1c47-4af3-9e13-0618b0b08054 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:57.070236 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-72d33c5b-c298-411d-aff2-f240885856eb tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:57.070966 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-72d33c5b-c298-411d-aff2-f240885856eb tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:57.082829 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-72d33c5b-c298-411d-aff2-f240885856eb tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:57.083338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-72d33c5b-c298-411d-aff2-f240885856eb tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:57.083777 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-72d33c5b-c298-411d-aff2-f240885856eb tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:57.084516 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-72d33c5b-c298-411d-aff2-f240885856eb tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:57.084968 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-72d33c5b-c298-411d-aff2-f240885856eb tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:57.085392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-72d33c5b-c298-411d-aff2-f240885856eb tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:57.310715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-72d33c5b-c298-411d-aff2-f240885856eb tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:57.314046 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2a88e22d-1c47-4af3-9e13-0618b0b08054 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:57.319572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-72d33c5b-c298-411d-aff2-f240885856eb tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.253417 Oct 14 17:55:57.320614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 63/125] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:57 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:55:57.322899 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2a88e22d-1c47-4af3-9e13-0618b0b08054 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1322 microversion: 2.1 time: 0.270845 Oct 14 17:55:57.323455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 63/126] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:57 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:57.994470 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ad1836a8-936a-4896-bb10-49e6ce46fd23 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:57.995016 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ad1836a8-936a-4896-bb10-49e6ce46fd23 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:57.996935 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:58.004125 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ad1836a8-936a-4896-bb10-49e6ce46fd23 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:58.004929 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ad1836a8-936a-4896-bb10-49e6ce46fd23 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:58.005369 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ad1836a8-936a-4896-bb10-49e6ce46fd23 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:58.006132 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ad1836a8-936a-4896-bb10-49e6ce46fd23 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:58.006588 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ad1836a8-936a-4896-bb10-49e6ce46fd23 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:58.007048 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ad1836a8-936a-4896-bb10-49e6ce46fd23 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:58.007622 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:58.009011 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:58.015892 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:58.016784 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:58.017438 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:58.018835 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:58.019429 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:58.019993 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:58.283538 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:58.297389 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:58.298900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:58.300224 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8aadfc31-f9c4-4668-bc5e-ea41318df9c7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.299006 Oct 14 17:55:58.304091 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ad1836a8-936a-4896-bb10-49e6ce46fd23 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:58.313734 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ad1836a8-936a-4896-bb10-49e6ce46fd23 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1502 microversion: 2.1 time: 0.323085 Oct 14 17:55:58.315752 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 64/127] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:57 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:55:58.316993 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 64/128] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:57 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1502 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:58.354188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3b9754b1-4c54-43c8-bc1e-45cab504f29c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:58.358735 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3b9754b1-4c54-43c8-bc1e-45cab504f29c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:58.359723 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8605f9fd-edc5-421f-9aa0-240915a3a21d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:58.362661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8605f9fd-edc5-421f-9aa0-240915a3a21d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:58.377351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8605f9fd-edc5-421f-9aa0-240915a3a21d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:58.378754 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b9754b1-4c54-43c8-bc1e-45cab504f29c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:58.379439 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b9754b1-4c54-43c8-bc1e-45cab504f29c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:58.379984 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b9754b1-4c54-43c8-bc1e-45cab504f29c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:58.380695 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8605f9fd-edc5-421f-9aa0-240915a3a21d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:58.381624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b9754b1-4c54-43c8-bc1e-45cab504f29c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:58.382387 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8605f9fd-edc5-421f-9aa0-240915a3a21d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:58.383699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8605f9fd-edc5-421f-9aa0-240915a3a21d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:58.384471 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b9754b1-4c54-43c8-bc1e-45cab504f29c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:58.384878 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b9754b1-4c54-43c8-bc1e-45cab504f29c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:58.386346 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8605f9fd-edc5-421f-9aa0-240915a3a21d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:58.386789 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8605f9fd-edc5-421f-9aa0-240915a3a21d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:58.789507 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8605f9fd-edc5-421f-9aa0-240915a3a21d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:58.799208 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8605f9fd-edc5-421f-9aa0-240915a3a21d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1322 microversion: 2.1 time: 0.455611 Oct 14 17:55:58.801338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 65/129] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:58 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:58.844438 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3b9754b1-4c54-43c8-bc1e-45cab504f29c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:58.856393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3b9754b1-4c54-43c8-bc1e-45cab504f29c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.515148 Oct 14 17:55:58.869582 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 65/130] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:58 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:55:59.048327 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-5263e727-2d9e-4051-8a69-43605b8f238d req-5a71e8dd-02a5-4a33-90d4-878314f20be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8dd3e30-1c69-471e-8b17-4205d267eb94", "name": "network-vif-plugged", "status": "completed", "tag": "26876ea9-63aa-403a-8423-dc062a217cc1"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:55:59.076746 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-5263e727-2d9e-4051-8a69-43605b8f238d req-5a71e8dd-02a5-4a33-90d4-878314f20be8 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:59.077599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-5263e727-2d9e-4051-8a69-43605b8f238d req-5a71e8dd-02a5-4a33-90d4-878314f20be8 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:59.078378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-5263e727-2d9e-4051-8a69-43605b8f238d req-5a71e8dd-02a5-4a33-90d4-878314f20be8 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:59.094151 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-5263e727-2d9e-4051-8a69-43605b8f238d req-5a71e8dd-02a5-4a33-90d4-878314f20be8 service nova] Creating event network-vif-plugged:26876ea9-63aa-403a-8423-dc062a217cc1 for instance c8dd3e30-1c69-471e-8b17-4205d267eb94 on hv-cinder-74915 Oct 14 17:55:59.100583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-5263e727-2d9e-4051-8a69-43605b8f238d req-5a71e8dd-02a5-4a33-90d4-878314f20be8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058817 Oct 14 17:55:59.101700 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 66/131] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:55:59.340744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:59.342025 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:59.360667 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:59.361160 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:59.362568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:59.363241 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:59.363696 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:59.364232 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:59.535241 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:59.543606 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:59.544911 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:55:59.545997 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ae0f7de8-89b9-4819-b6b5-8450103b188d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.209914 Oct 14 17:55:59.546716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 66/132] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:55:59 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:55:59.826184 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9c4efee4-5628-4b50-b139-f213cf6280ca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:59.826884 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9c4efee4-5628-4b50-b139-f213cf6280ca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:59.846630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9c4efee4-5628-4b50-b139-f213cf6280ca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:59.847121 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9c4efee4-5628-4b50-b139-f213cf6280ca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:59.847565 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9c4efee4-5628-4b50-b139-f213cf6280ca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:59.848287 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9c4efee4-5628-4b50-b139-f213cf6280ca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:59.856398 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9c4efee4-5628-4b50-b139-f213cf6280ca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:59.859417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9c4efee4-5628-4b50-b139-f213cf6280ca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:59.891000 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-753ff147-7176-4738-998d-ae8156dca807 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:55:59.894891 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-753ff147-7176-4738-998d-ae8156dca807 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:55:59.923729 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-753ff147-7176-4738-998d-ae8156dca807 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:59.924463 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-753ff147-7176-4738-998d-ae8156dca807 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:59.925983 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-753ff147-7176-4738-998d-ae8156dca807 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:55:59.927264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-753ff147-7176-4738-998d-ae8156dca807 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:55:59.928248 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-753ff147-7176-4738-998d-ae8156dca807 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:55:59.928882 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-753ff147-7176-4738-998d-ae8156dca807 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:00.220734 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-9c4efee4-5628-4b50-b139-f213cf6280ca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:00.229303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9c4efee4-5628-4b50-b139-f213cf6280ca tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1515 microversion: 2.1 time: 0.409663 Oct 14 17:56:00.229944 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 67/133] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:59 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1515 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:00.235740 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8e10c453-20ba-4758-8f21-49542a5654d2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "331f88c5-5b05-4015-b35b-02bc804748fa"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:00.238108 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8e10c453-20ba-4758-8f21-49542a5654d2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:00.244414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e10c453-20ba-4758-8f21-49542a5654d2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:00.244895 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e10c453-20ba-4758-8f21-49542a5654d2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:00.245550 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e10c453-20ba-4758-8f21-49542a5654d2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:00.246280 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e10c453-20ba-4758-8f21-49542a5654d2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:00.246734 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e10c453-20ba-4758-8f21-49542a5654d2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:00.247320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e10c453-20ba-4758-8f21-49542a5654d2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:00.267965 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-753ff147-7176-4738-998d-ae8156dca807 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:00.276826 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-753ff147-7176-4738-998d-ae8156dca807 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.395566 Oct 14 17:56:00.278683 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 67/134] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:55:59 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:00.284327 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ebb33273-b746-4a1d-b74c-d4f3ba627ecd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:00.286860 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ebb33273-b746-4a1d-b74c-d4f3ba627ecd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:00.298541 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebb33273-b746-4a1d-b74c-d4f3ba627ecd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:00.299125 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebb33273-b746-4a1d-b74c-d4f3ba627ecd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:00.299630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebb33273-b746-4a1d-b74c-d4f3ba627ecd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:00.300439 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebb33273-b746-4a1d-b74c-d4f3ba627ecd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:00.300956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebb33273-b746-4a1d-b74c-d4f3ba627ecd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:00.301450 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebb33273-b746-4a1d-b74c-d4f3ba627ecd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:00.380695 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-ebb33273-b746-4a1d-b74c-d4f3ba627ecd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lazy-loading 'flavor' on Instance uuid 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:56:00.514122 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ebb33273-b746-4a1d-b74c-d4f3ba627ecd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020/action" status: 200 len: 32 microversion: 2.1 time: 0.233831 Oct 14 17:56:00.516021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 68/135] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:56:00 2022] POST /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 17:56:00.526788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bcbb9a8f-7cc1-450a-a0ee-49cb6b7c3acf tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:00.527699 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bcbb9a8f-7cc1-450a-a0ee-49cb6b7c3acf tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:00.534475 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcbb9a8f-7cc1-450a-a0ee-49cb6b7c3acf tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:00.535043 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcbb9a8f-7cc1-450a-a0ee-49cb6b7c3acf tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:00.535473 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcbb9a8f-7cc1-450a-a0ee-49cb6b7c3acf tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:00.536196 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcbb9a8f-7cc1-450a-a0ee-49cb6b7c3acf tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:00.536630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcbb9a8f-7cc1-450a-a0ee-49cb6b7c3acf tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:00.537042 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcbb9a8f-7cc1-450a-a0ee-49cb6b7c3acf tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:00.687898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bcbb9a8f-7cc1-450a-a0ee-49cb6b7c3acf tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:00.698942 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bcbb9a8f-7cc1-450a-a0ee-49cb6b7c3acf tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.177986 Oct 14 17:56:00.699525 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 69/136] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:00 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:00.705153 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:00.705859 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:00.713169 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:00.714019 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:00.714598 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:00.715438 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:00.716074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:00.716635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:00.855358 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:00.863354 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:00.864827 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:00.865922 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4126a804-2d6e-4275-a037-9a44df82ccb3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.165228 Oct 14 17:56:00.866478 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 70/137] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:56:00 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:56:01.119468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-2b71ebb7-061d-4e31-9f48-15a97460f7d8 req-e8831d72-8308-4a8e-8c3d-8b491bf2eefb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c0a43e-1109-4ff9-9617-8a2958de7b0b", "name": "network-vif-plugged", "status": "completed", "tag": "04f9946a-535a-428e-8287-bac5d55cc781"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:01.129637 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2b71ebb7-061d-4e31-9f48-15a97460f7d8 req-e8831d72-8308-4a8e-8c3d-8b491bf2eefb service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:01.130271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2b71ebb7-061d-4e31-9f48-15a97460f7d8 req-e8831d72-8308-4a8e-8c3d-8b491bf2eefb service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:01.130794 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2b71ebb7-061d-4e31-9f48-15a97460f7d8 req-e8831d72-8308-4a8e-8c3d-8b491bf2eefb service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:01.142286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-2b71ebb7-061d-4e31-9f48-15a97460f7d8 req-e8831d72-8308-4a8e-8c3d-8b491bf2eefb service nova] Creating event network-vif-plugged:04f9946a-535a-428e-8287-bac5d55cc781 for instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b on hv-cinder-74915 Oct 14 17:56:01.147199 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-2b71ebb7-061d-4e31-9f48-15a97460f7d8 req-e8831d72-8308-4a8e-8c3d-8b491bf2eefb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032202 Oct 14 17:56:01.147773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 71/138] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:01.304305 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-afe9db6a-cd7b-4201-9267-770490cc3672 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:01.305989 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-afe9db6a-cd7b-4201-9267-770490cc3672 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:01.312037 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-afe9db6a-cd7b-4201-9267-770490cc3672 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:01.312510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-afe9db6a-cd7b-4201-9267-770490cc3672 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:01.312933 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-afe9db6a-cd7b-4201-9267-770490cc3672 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:01.313606 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-afe9db6a-cd7b-4201-9267-770490cc3672 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:01.314049 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-afe9db6a-cd7b-4201-9267-770490cc3672 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:01.314460 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-afe9db6a-cd7b-4201-9267-770490cc3672 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:01.464680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-afe9db6a-cd7b-4201-9267-770490cc3672 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:01.472227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-afe9db6a-cd7b-4201-9267-770490cc3672 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.172088 Oct 14 17:56:01.472790 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 72/139] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:01 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:01.724271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0ea0ea25-39ce-4cb3-aef3-70329af1260b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:01.724783 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0ea0ea25-39ce-4cb3-aef3-70329af1260b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:01.730675 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ea0ea25-39ce-4cb3-aef3-70329af1260b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:01.731265 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ea0ea25-39ce-4cb3-aef3-70329af1260b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:01.731700 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ea0ea25-39ce-4cb3-aef3-70329af1260b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:01.732405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ea0ea25-39ce-4cb3-aef3-70329af1260b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:01.732850 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ea0ea25-39ce-4cb3-aef3-70329af1260b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:01.733268 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ea0ea25-39ce-4cb3-aef3-70329af1260b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:01.858446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0ea0ea25-39ce-4cb3-aef3-70329af1260b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:01.866082 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0ea0ea25-39ce-4cb3-aef3-70329af1260b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.145778 Oct 14 17:56:01.866646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 73/140] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:01 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:01.890062 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:01.890658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:01.893413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=100 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:01.896950 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:01.897430 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:01.897855 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:01.899149 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:01.899596 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:01.900067 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:01.918619 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:02.030089 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:02.038358 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:02.039865 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:02.040983 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9c544c88-acff-4f6e-ba98-0e42bf497964 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.154579 Oct 14 17:56:02.041733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 74/141] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:56:01 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:56:02.495537 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-aeb451d3-d3c6-4e8e-b9dd-7c93fabdd779 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:02.496210 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-aeb451d3-d3c6-4e8e-b9dd-7c93fabdd779 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:02.502018 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aeb451d3-d3c6-4e8e-b9dd-7c93fabdd779 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:02.502491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aeb451d3-d3c6-4e8e-b9dd-7c93fabdd779 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:02.502923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aeb451d3-d3c6-4e8e-b9dd-7c93fabdd779 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:02.503599 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aeb451d3-d3c6-4e8e-b9dd-7c93fabdd779 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:02.504074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aeb451d3-d3c6-4e8e-b9dd-7c93fabdd779 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:02.504493 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aeb451d3-d3c6-4e8e-b9dd-7c93fabdd779 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:02.630661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-aeb451d3-d3c6-4e8e-b9dd-7c93fabdd779 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:02.638748 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-aeb451d3-d3c6-4e8e-b9dd-7c93fabdd779 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1361 microversion: 2.1 time: 0.147182 Oct 14 17:56:02.639282 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 75/142] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:02 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:02.889010 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-50486e6b-40b9-4f8d-b509-7c89ac4ade13 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:02.889621 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-50486e6b-40b9-4f8d-b509-7c89ac4ade13 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:02.895624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50486e6b-40b9-4f8d-b509-7c89ac4ade13 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:02.896132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50486e6b-40b9-4f8d-b509-7c89ac4ade13 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:02.896557 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50486e6b-40b9-4f8d-b509-7c89ac4ade13 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:02.897234 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50486e6b-40b9-4f8d-b509-7c89ac4ade13 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:02.897678 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50486e6b-40b9-4f8d-b509-7c89ac4ade13 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:02.898091 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50486e6b-40b9-4f8d-b509-7c89ac4ade13 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:03.026191 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-50486e6b-40b9-4f8d-b509-7c89ac4ade13 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:03.033903 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-50486e6b-40b9-4f8d-b509-7c89ac4ade13 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.148470 Oct 14 17:56:03.034476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 76/143] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:02 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:03.065290 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:03.065814 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:03.072152 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:03.072619 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:03.073040 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:03.073714 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:03.074149 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:03.074559 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:03.202158 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:03.210301 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:03.211869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:03.213026 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3b210220-b282-42bb-b357-bd23a699a23e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.151415 Oct 14 17:56:03.213596 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 77/144] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:56:03 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:56:03.402706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8e10c453-20ba-4758-8f21-49542a5654d2 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "POST /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.171052 Oct 14 17:56:03.403486 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 68/145] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 17:56:00 2022] POST /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846/os-volume_attachments => generated 194 bytes in 3172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:03.662574 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2aa301f8-4b95-45b4-913b-b225b9b89ea6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:03.663159 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2aa301f8-4b95-45b4-913b-b225b9b89ea6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:03.669691 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2aa301f8-4b95-45b4-913b-b225b9b89ea6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:03.670168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2aa301f8-4b95-45b4-913b-b225b9b89ea6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:03.670602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2aa301f8-4b95-45b4-913b-b225b9b89ea6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:03.671285 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2aa301f8-4b95-45b4-913b-b225b9b89ea6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:03.671737 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2aa301f8-4b95-45b4-913b-b225b9b89ea6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:03.672207 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2aa301f8-4b95-45b4-913b-b225b9b89ea6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:03.805786 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2aa301f8-4b95-45b4-913b-b225b9b89ea6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:03.814131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2aa301f8-4b95-45b4-913b-b225b9b89ea6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1548 microversion: 2.1 time: 0.155780 Oct 14 17:56:03.814699 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 78/146] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:03 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:03.839566 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f11dd73c-bb83-4087-a5ff-cadbe86d7a92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:03.840602 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f11dd73c-bb83-4087-a5ff-cadbe86d7a92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:03.848640 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f11dd73c-bb83-4087-a5ff-cadbe86d7a92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:03.849423 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f11dd73c-bb83-4087-a5ff-cadbe86d7a92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:03.849930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f11dd73c-bb83-4087-a5ff-cadbe86d7a92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:03.850695 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f11dd73c-bb83-4087-a5ff-cadbe86d7a92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:03.851221 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f11dd73c-bb83-4087-a5ff-cadbe86d7a92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:03.852347 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f11dd73c-bb83-4087-a5ff-cadbe86d7a92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:03.989069 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f11dd73c-bb83-4087-a5ff-cadbe86d7a92 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154755 Oct 14 17:56:03.990026 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 69/147] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Oct 14 17:56:03 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:04.059298 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0fd7a8f6-e929-4966-a32d-c30be72c77ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:04.060042 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0fd7a8f6-e929-4966-a32d-c30be72c77ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:04.068074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fd7a8f6-e929-4966-a32d-c30be72c77ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:04.069337 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fd7a8f6-e929-4966-a32d-c30be72c77ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:04.069983 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fd7a8f6-e929-4966-a32d-c30be72c77ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:04.071453 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fd7a8f6-e929-4966-a32d-c30be72c77ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:04.072128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fd7a8f6-e929-4966-a32d-c30be72c77ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:04.072970 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fd7a8f6-e929-4966-a32d-c30be72c77ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:04.235135 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0fd7a8f6-e929-4966-a32d-c30be72c77ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:04.240612 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:04.241233 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:04.244487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0fd7a8f6-e929-4966-a32d-c30be72c77ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.191143 Oct 14 17:56:04.245262 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 79/148] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:04 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:04.263939 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:04.264431 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:04.264882 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:04.265581 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:04.266061 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:04.266508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:04.467939 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:04.480438 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:04.499902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:04.501122 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3ce7dc71-8067-4ecb-88fe-ced04b9eb434 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.264228 Oct 14 17:56:04.502066 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 70/149] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:56:04 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:56:05.270954 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c3d5d746-6188-434e-97ac-4cda7405eb9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:05.271583 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c3d5d746-6188-434e-97ac-4cda7405eb9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:05.281335 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c3d5d746-6188-434e-97ac-4cda7405eb9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:05.281817 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c3d5d746-6188-434e-97ac-4cda7405eb9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:05.282236 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c3d5d746-6188-434e-97ac-4cda7405eb9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:05.284225 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c3d5d746-6188-434e-97ac-4cda7405eb9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:05.284671 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c3d5d746-6188-434e-97ac-4cda7405eb9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:05.285466 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c3d5d746-6188-434e-97ac-4cda7405eb9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:05.527570 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:05.528809 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:05.537794 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=81 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:05.540861 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:05.544320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:05.545029 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:05.546022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:05.552478 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:05.553237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:05.739201 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c3d5d746-6188-434e-97ac-4cda7405eb9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:05.750601 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c3d5d746-6188-434e-97ac-4cda7405eb9c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.484459 Oct 14 17:56:05.751478 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 80/150] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:05 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:05.883301 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-70bb3295-ad77-4d3d-9c09-d84cc8ced688 req-37c99589-30dd-44e1-a5a1-3eac2574045a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8dd3e30-1c69-471e-8b17-4205d267eb94", "tag": "26876ea9-63aa-403a-8423-dc062a217cc1"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:05.897485 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:05.899367 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-70bb3295-ad77-4d3d-9c09-d84cc8ced688 req-37c99589-30dd-44e1-a5a1-3eac2574045a service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:05.900358 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-70bb3295-ad77-4d3d-9c09-d84cc8ced688 req-37c99589-30dd-44e1-a5a1-3eac2574045a service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:05.901178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-70bb3295-ad77-4d3d-9c09-d84cc8ced688 req-37c99589-30dd-44e1-a5a1-3eac2574045a service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:05.907246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:05.909200 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:05.910603 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-44794af8-25db-4105-ab11-6574bb457b21 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1407 microversion: 2.20 time: 0.388396 Oct 14 17:56:05.911377 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 71/151] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:56:05 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:56:05.915298 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-70bb3295-ad77-4d3d-9c09-d84cc8ced688 req-37c99589-30dd-44e1-a5a1-3eac2574045a service nova] Creating event network-changed:26876ea9-63aa-403a-8423-dc062a217cc1 for instance c8dd3e30-1c69-471e-8b17-4205d267eb94 on hv-cinder-74915 Oct 14 17:56:05.921048 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-70bb3295-ad77-4d3d-9c09-d84cc8ced688 req-37c99589-30dd-44e1-a5a1-3eac2574045a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041413 Oct 14 17:56:05.922385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 81/152] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:06.781101 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4c0779db-8cfe-4f27-9067-6eee0b80f51d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:06.781709 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4c0779db-8cfe-4f27-9067-6eee0b80f51d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:06.793287 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c0779db-8cfe-4f27-9067-6eee0b80f51d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:06.793857 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c0779db-8cfe-4f27-9067-6eee0b80f51d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:06.794374 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c0779db-8cfe-4f27-9067-6eee0b80f51d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:06.795158 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c0779db-8cfe-4f27-9067-6eee0b80f51d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:06.795692 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c0779db-8cfe-4f27-9067-6eee0b80f51d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:06.796240 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c0779db-8cfe-4f27-9067-6eee0b80f51d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:06.937533 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:06.938230 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:06.947095 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:06.947932 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:06.948522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:06.949544 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:06.950153 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:06.950724 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:07.399662 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:07.401059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-4c0779db-8cfe-4f27-9067-6eee0b80f51d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:07.409012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:07.410614 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:07.411169 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4c0779db-8cfe-4f27-9067-6eee0b80f51d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.633808 Oct 14 17:56:07.412010 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-91177660-b76a-4258-abc7-a06c429e8da6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1599 microversion: 2.20 time: 0.478967 Oct 14 17:56:07.412810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 82/154] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:56:06 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1599 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:56:07.413972 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 72/154] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:06 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:07.438101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-094c6788-e3c4-471a-bc14-0e57eeee0b51 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:07.438625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-094c6788-e3c4-471a-bc14-0e57eeee0b51 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:07.444900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-094c6788-e3c4-471a-bc14-0e57eeee0b51 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:07.445530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-094c6788-e3c4-471a-bc14-0e57eeee0b51 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:07.445967 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-094c6788-e3c4-471a-bc14-0e57eeee0b51 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:07.447516 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-094c6788-e3c4-471a-bc14-0e57eeee0b51 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:07.448165 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-094c6788-e3c4-471a-bc14-0e57eeee0b51 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:07.448595 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-094c6788-e3c4-471a-bc14-0e57eeee0b51 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:07.537467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-094c6788-e3c4-471a-bc14-0e57eeee0b51 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103338 Oct 14 17:56:07.538265 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 83/155] 10.222.0.27 () {60 vars in 1316 bytes} [Fri Oct 14 17:56:07 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:56:08.435313 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-889b68ab-031c-4d89-80f1-81bb3eb7aef6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:08.436880 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-889b68ab-031c-4d89-80f1-81bb3eb7aef6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:08.443810 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-889b68ab-031c-4d89-80f1-81bb3eb7aef6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:08.445279 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-889b68ab-031c-4d89-80f1-81bb3eb7aef6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:08.446440 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-889b68ab-031c-4d89-80f1-81bb3eb7aef6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:08.447401 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-889b68ab-031c-4d89-80f1-81bb3eb7aef6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:08.448080 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-889b68ab-031c-4d89-80f1-81bb3eb7aef6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:08.448739 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-889b68ab-031c-4d89-80f1-81bb3eb7aef6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:08.745659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-889b68ab-031c-4d89-80f1-81bb3eb7aef6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:08.753745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-889b68ab-031c-4d89-80f1-81bb3eb7aef6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.322708 Oct 14 17:56:08.757302 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 73/156] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:08 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:09.160470 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-7083195c-ed90-49b3-a2c6-69904b767b21 req-4b648733-c40e-4040-b4aa-d254db26d72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c0a43e-1109-4ff9-9617-8a2958de7b0b", "tag": "04f9946a-535a-428e-8287-bac5d55cc781"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:09.178056 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-7083195c-ed90-49b3-a2c6-69904b767b21 req-4b648733-c40e-4040-b4aa-d254db26d72c service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:09.178732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-7083195c-ed90-49b3-a2c6-69904b767b21 req-4b648733-c40e-4040-b4aa-d254db26d72c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:09.179380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-7083195c-ed90-49b3-a2c6-69904b767b21 req-4b648733-c40e-4040-b4aa-d254db26d72c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:09.192592 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-7083195c-ed90-49b3-a2c6-69904b767b21 req-4b648733-c40e-4040-b4aa-d254db26d72c service nova] Creating event network-changed:04f9946a-535a-428e-8287-bac5d55cc781 for instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b on hv-cinder-74915 Oct 14 17:56:09.200862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-7083195c-ed90-49b3-a2c6-69904b767b21 req-4b648733-c40e-4040-b4aa-d254db26d72c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045247 Oct 14 17:56:09.202002 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 84/157] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:09.781121 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2fbfb569-679c-43a0-9898-62069ed12613 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:09.782584 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2fbfb569-679c-43a0-9898-62069ed12613 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:09.800184 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2fbfb569-679c-43a0-9898-62069ed12613 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:09.801227 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2fbfb569-679c-43a0-9898-62069ed12613 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:09.801897 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2fbfb569-679c-43a0-9898-62069ed12613 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:09.806636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2fbfb569-679c-43a0-9898-62069ed12613 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:09.807395 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2fbfb569-679c-43a0-9898-62069ed12613 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:09.808126 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2fbfb569-679c-43a0-9898-62069ed12613 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:10.279957 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2fbfb569-679c-43a0-9898-62069ed12613 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:10.291690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2fbfb569-679c-43a0-9898-62069ed12613 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.513789 Oct 14 17:56:10.297654 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 74/158] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:09 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:11.319413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0d1de44e-801c-4cdc-9c3d-6ce76a8c44e7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:11.320157 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0d1de44e-801c-4cdc-9c3d-6ce76a8c44e7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:11.327071 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1de44e-801c-4cdc-9c3d-6ce76a8c44e7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:11.327618 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1de44e-801c-4cdc-9c3d-6ce76a8c44e7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:11.328146 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1de44e-801c-4cdc-9c3d-6ce76a8c44e7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:11.328936 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1de44e-801c-4cdc-9c3d-6ce76a8c44e7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:11.329461 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1de44e-801c-4cdc-9c3d-6ce76a8c44e7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:11.329898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1de44e-801c-4cdc-9c3d-6ce76a8c44e7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:11.473394 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0d1de44e-801c-4cdc-9c3d-6ce76a8c44e7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:11.481097 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0d1de44e-801c-4cdc-9c3d-6ce76a8c44e7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.166063 Oct 14 17:56:11.481661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 85/159] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:11 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:12.503679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-433b2463-b0fc-4464-89aa-5336fadcf526 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:12.504467 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-433b2463-b0fc-4464-89aa-5336fadcf526 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:12.512394 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-433b2463-b0fc-4464-89aa-5336fadcf526 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:12.513026 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-433b2463-b0fc-4464-89aa-5336fadcf526 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:12.513502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-433b2463-b0fc-4464-89aa-5336fadcf526 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:12.514303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-433b2463-b0fc-4464-89aa-5336fadcf526 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:12.515050 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-433b2463-b0fc-4464-89aa-5336fadcf526 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:12.515464 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-433b2463-b0fc-4464-89aa-5336fadcf526 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:12.676257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-433b2463-b0fc-4464-89aa-5336fadcf526 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:12.685546 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-433b2463-b0fc-4464-89aa-5336fadcf526 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.185560 Oct 14 17:56:12.698644 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 75/160] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:12 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:13.271623 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a7bf1ed5-5658-421e-9ef6-ddaa25e863e7 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:13.272265 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a7bf1ed5-5658-421e-9ef6-ddaa25e863e7 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:13.280193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a7bf1ed5-5658-421e-9ef6-ddaa25e863e7 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:13.280738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a7bf1ed5-5658-421e-9ef6-ddaa25e863e7 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:13.281337 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a7bf1ed5-5658-421e-9ef6-ddaa25e863e7 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:13.282186 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a7bf1ed5-5658-421e-9ef6-ddaa25e863e7 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:13.282633 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a7bf1ed5-5658-421e-9ef6-ddaa25e863e7 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:13.283051 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a7bf1ed5-5658-421e-9ef6-ddaa25e863e7 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:13.311159 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a7bf1ed5-5658-421e-9ef6-ddaa25e863e7 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 17:56:13.402935 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a7bf1ed5-5658-421e-9ef6-ddaa25e863e7 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 204 len: 0 microversion: 2.1 time: 0.135030 Oct 14 17:56:13.403513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 86/161] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 17:56:13 2022] DELETE /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 17:56:13.412265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-826090ae-dfef-4bcb-b837-f3b08ac46f6e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:13.413177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-826090ae-dfef-4bcb-b837-f3b08ac46f6e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:13.420681 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-826090ae-dfef-4bcb-b837-f3b08ac46f6e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:13.421693 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-826090ae-dfef-4bcb-b837-f3b08ac46f6e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:13.422105 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-826090ae-dfef-4bcb-b837-f3b08ac46f6e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:13.422951 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-826090ae-dfef-4bcb-b837-f3b08ac46f6e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:13.423328 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-826090ae-dfef-4bcb-b837-f3b08ac46f6e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:13.423732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-826090ae-dfef-4bcb-b837-f3b08ac46f6e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:13.566546 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-826090ae-dfef-4bcb-b837-f3b08ac46f6e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:13.576416 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-826090ae-dfef-4bcb-b837-f3b08ac46f6e tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1554 microversion: 2.1 time: 0.168669 Oct 14 17:56:13.577010 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 76/162] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:13 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:13.710168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c67975dd-6c4f-4941-824c-c63c3f6fd985 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:13.710802 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c67975dd-6c4f-4941-824c-c63c3f6fd985 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:13.717634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c67975dd-6c4f-4941-824c-c63c3f6fd985 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:13.718118 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c67975dd-6c4f-4941-824c-c63c3f6fd985 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:13.718800 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c67975dd-6c4f-4941-824c-c63c3f6fd985 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:13.719762 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c67975dd-6c4f-4941-824c-c63c3f6fd985 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:13.720439 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c67975dd-6c4f-4941-824c-c63c3f6fd985 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:13.721161 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c67975dd-6c4f-4941-824c-c63c3f6fd985 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:13.878649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c67975dd-6c4f-4941-824c-c63c3f6fd985 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:13.890082 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c67975dd-6c4f-4941-824c-c63c3f6fd985 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.183877 Oct 14 17:56:13.890952 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 87/163] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:13 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:14.606106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1dbf1cd4-6169-4e5e-b24d-23e5e106652d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:14.606838 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1dbf1cd4-6169-4e5e-b24d-23e5e106652d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:14.612935 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1dbf1cd4-6169-4e5e-b24d-23e5e106652d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:14.613501 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1dbf1cd4-6169-4e5e-b24d-23e5e106652d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:14.614095 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1dbf1cd4-6169-4e5e-b24d-23e5e106652d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:14.614879 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1dbf1cd4-6169-4e5e-b24d-23e5e106652d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:14.615500 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1dbf1cd4-6169-4e5e-b24d-23e5e106652d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:14.616031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1dbf1cd4-6169-4e5e-b24d-23e5e106652d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:14.773576 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1dbf1cd4-6169-4e5e-b24d-23e5e106652d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:14.782904 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1dbf1cd4-6169-4e5e-b24d-23e5e106652d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1554 microversion: 2.1 time: 0.184927 Oct 14 17:56:14.783483 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 77/164] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:14 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:14.917926 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6662db2c-56c6-44f0-add4-4be228e90c44 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:14.919636 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6662db2c-56c6-44f0-add4-4be228e90c44 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:14.926850 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6662db2c-56c6-44f0-add4-4be228e90c44 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:14.927452 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6662db2c-56c6-44f0-add4-4be228e90c44 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:14.928163 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6662db2c-56c6-44f0-add4-4be228e90c44 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:14.929099 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6662db2c-56c6-44f0-add4-4be228e90c44 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:14.929614 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6662db2c-56c6-44f0-add4-4be228e90c44 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:14.930885 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6662db2c-56c6-44f0-add4-4be228e90c44 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:15.085264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6662db2c-56c6-44f0-add4-4be228e90c44 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:15.094952 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6662db2c-56c6-44f0-add4-4be228e90c44 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.184351 Oct 14 17:56:15.095853 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 88/165] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:14 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:15.807311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ec6f8256-c70f-4545-8cfa-0f9a54ba8dbb tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:15.807663 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ec6f8256-c70f-4545-8cfa-0f9a54ba8dbb tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:15.816320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec6f8256-c70f-4545-8cfa-0f9a54ba8dbb tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:15.817340 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec6f8256-c70f-4545-8cfa-0f9a54ba8dbb tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:15.818256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec6f8256-c70f-4545-8cfa-0f9a54ba8dbb tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:15.819475 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec6f8256-c70f-4545-8cfa-0f9a54ba8dbb tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:15.821380 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec6f8256-c70f-4545-8cfa-0f9a54ba8dbb tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:15.822305 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec6f8256-c70f-4545-8cfa-0f9a54ba8dbb tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:16.033658 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ec6f8256-c70f-4545-8cfa-0f9a54ba8dbb tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:16.046744 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ec6f8256-c70f-4545-8cfa-0f9a54ba8dbb tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1554 microversion: 2.1 time: 0.244824 Oct 14 17:56:16.048008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 78/166] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:15 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:16.119654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-1a54f230-1c4b-4089-aff9-c1d50f0c63fb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:16.128109 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-1a54f230-1c4b-4089-aff9-c1d50f0c63fb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:16.128905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1a54f230-1c4b-4089-aff9-c1d50f0c63fb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:16.130343 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1a54f230-1c4b-4089-aff9-c1d50f0c63fb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:16.133075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1a54f230-1c4b-4089-aff9-c1d50f0c63fb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:16.134229 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1a54f230-1c4b-4089-aff9-c1d50f0c63fb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:16.135206 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1a54f230-1c4b-4089-aff9-c1d50f0c63fb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:16.136794 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1a54f230-1c4b-4089-aff9-c1d50f0c63fb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:16.426692 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1a54f230-1c4b-4089-aff9-c1d50f0c63fb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:16.437127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-1a54f230-1c4b-4089-aff9-c1d50f0c63fb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.322123 Oct 14 17:56:16.458832 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 89/167] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:16 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:16.771417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-0af06e4c-9a60-49f7-b5d5-b5f02484595b req-191317af-59ac-479b-be86-96820c7c3db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b519c690-9e51-4863-89b4-ee2a3a5d8846", "name": "network-vif-deleted", "tag": "4fabe4d0-728b-4fc6-a568-02ede59f8a1d"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:16.789109 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-0af06e4c-9a60-49f7-b5d5-b5f02484595b req-191317af-59ac-479b-be86-96820c7c3db0 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:16.790779 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-0af06e4c-9a60-49f7-b5d5-b5f02484595b req-191317af-59ac-479b-be86-96820c7c3db0 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:16.791865 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-0af06e4c-9a60-49f7-b5d5-b5f02484595b req-191317af-59ac-479b-be86-96820c7c3db0 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:16.796299 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:16.806617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-0af06e4c-9a60-49f7-b5d5-b5f02484595b req-191317af-59ac-479b-be86-96820c7c3db0 service nova] Creating event network-vif-deleted:4fabe4d0-728b-4fc6-a568-02ede59f8a1d for instance b519c690-9e51-4863-89b4-ee2a3a5d8846 on hv-cinder-74915 Oct 14 17:56:16.812718 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-0af06e4c-9a60-49f7-b5d5-b5f02484595b req-191317af-59ac-479b-be86-96820c7c3db0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047706 Oct 14 17:56:16.813325 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 79/168] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:17.072875 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-686578b1-21d6-42ff-96be-c17dfb99438b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:17.073544 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-686578b1-21d6-42ff-96be-c17dfb99438b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:17.081261 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-686578b1-21d6-42ff-96be-c17dfb99438b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:17.082014 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-686578b1-21d6-42ff-96be-c17dfb99438b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:17.082451 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-686578b1-21d6-42ff-96be-c17dfb99438b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:17.083166 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-686578b1-21d6-42ff-96be-c17dfb99438b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:17.083671 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-686578b1-21d6-42ff-96be-c17dfb99438b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:17.084121 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-686578b1-21d6-42ff-96be-c17dfb99438b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:17.158467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-686578b1-21d6-42ff-96be-c17dfb99438b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07441f3b8a3841b0ba3677ec38fe7f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe90c27e0e44c4794ccff00eac150ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:17.167528 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-686578b1-21d6-42ff-96be-c17dfb99438b tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 200 len: 1346 microversion: 2.1 time: 0.099782 Oct 14 17:56:17.168315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 90/169] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:17 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:17.466803 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ecf9f544-37db-4c67-84ab-9442dbc17e9d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:17.467496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ecf9f544-37db-4c67-84ab-9442dbc17e9d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:17.475225 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ecf9f544-37db-4c67-84ab-9442dbc17e9d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:17.475708 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ecf9f544-37db-4c67-84ab-9442dbc17e9d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:17.476169 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ecf9f544-37db-4c67-84ab-9442dbc17e9d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:17.477053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ecf9f544-37db-4c67-84ab-9442dbc17e9d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:17.477625 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ecf9f544-37db-4c67-84ab-9442dbc17e9d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:17.478062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ecf9f544-37db-4c67-84ab-9442dbc17e9d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:17.620050 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ecf9f544-37db-4c67-84ab-9442dbc17e9d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:17.628333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ecf9f544-37db-4c67-84ab-9442dbc17e9d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.165471 Oct 14 17:56:17.628934 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 80/170] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:17 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:18.190920 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:18.191477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:18.211737 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:18.212394 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:18.212823 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:18.213522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:18.213993 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:18.214411 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:18.218563 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:18.229345 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] HTTP exception thrown: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Request method failure captured: Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 HTTP/1.1 Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaKClKPm9yqhNSZQqBF8l8xX45TM8gk2dRP4POHhN60Mpa5Yir767HOm_PJBfgLj3E5nDEHW1J5SewYHZPk9SFt9rxLuYP1DQZaZZl7yCzFwC5fCJanoBamxdrrDzG58jF82QtZzV1hqixjU7_vbIb33VHtTynJnnDTq045A9ctk4tA Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: bfe90c27e0e44c4794ccff00eac150ca Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 17:56:18.241150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfe90c27e0e44c4794ccff00eac150ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: bfe90c27e0e44c4794ccff00eac150ca Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-DeleteServersTestJSON-2047629068-project Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 07441f3b8a3841b0ba3677ec38fe7f32 Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-DeleteServersTestJSON-2047629068-project Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:18.242630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'b519c690-9e51-4863-89b4-ee2a3a5d8846'} Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:56:18.243380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:18.244704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:18.245915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Returning 404 to user: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:56:18.245915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5e0a59b7-412d-4347-81c2-16d8f7b5fa28 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 404 len: 111 microversion: 2.1 time: 0.056073 Oct 14 17:56:18.245915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 91/171] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:18 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 17:56:18.363791 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:18.366153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:18.373364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:18.373888 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:18.374428 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:18.375215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:18.375938 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:18.376416 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:18.393516 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] HTTP exception thrown: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Request method failure captured: Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846/os-volume_attachments HTTP/1.1 Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaKClKPm9yqhNSZQqBF8l8xX45TM8gk2dRP4POHhN60Mpa5Yir767HOm_PJBfgLj3E5nDEHW1J5SewYHZPk9SFt9rxLuYP1DQZaZZl7yCzFwC5fCJanoBamxdrrDzG58jF82QtZzV1hqixjU7_vbIb33VHtTynJnnDTq045A9ctk4tA Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: bfe90c27e0e44c4794ccff00eac150ca Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 17:56:18.400818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfe90c27e0e44c4794ccff00eac150ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: bfe90c27e0e44c4794ccff00eac150ca Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-DeleteServersTestJSON-2047629068-project Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 07441f3b8a3841b0ba3677ec38fe7f32 Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-DeleteServersTestJSON-2047629068-project Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:18.402265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'server_id': 'b519c690-9e51-4863-89b4-ee2a3a5d8846'} Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:56:18.403039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:18.404106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:56:18.405154 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Returning 404 to user: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:56:18.405154 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-eccf3ffc-642a-410f-a193-e0b15093423d tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042570 Oct 14 17:56:18.405154 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 81/172] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 17:56:18 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 17:56:18.652599 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f5966ac5-02d3-4b6f-89b5-10aa0f668999 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:18.653200 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f5966ac5-02d3-4b6f-89b5-10aa0f668999 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:18.660882 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5966ac5-02d3-4b6f-89b5-10aa0f668999 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:18.661326 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5966ac5-02d3-4b6f-89b5-10aa0f668999 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:18.661746 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5966ac5-02d3-4b6f-89b5-10aa0f668999 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:18.662467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5966ac5-02d3-4b6f-89b5-10aa0f668999 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:18.662869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5966ac5-02d3-4b6f-89b5-10aa0f668999 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:18.663285 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5966ac5-02d3-4b6f-89b5-10aa0f668999 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:18.801128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f5966ac5-02d3-4b6f-89b5-10aa0f668999 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:18.810017 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f5966ac5-02d3-4b6f-89b5-10aa0f668999 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.161897 Oct 14 17:56:18.810576 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 92/173] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:18 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:19.621203 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:19.621692 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:19.628105 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:19.628576 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:19.629001 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:19.629670 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:19.630111 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:19.630527 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:19.643515 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] HTTP exception thrown: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Request method failure captured: Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: DELETE /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 HTTP/1.1 Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaKClKPm9yqhNSZQqBF8l8xX45TM8gk2dRP4POHhN60Mpa5Yir767HOm_PJBfgLj3E5nDEHW1J5SewYHZPk9SFt9rxLuYP1DQZaZZl7yCzFwC5fCJanoBamxdrrDzG58jF82QtZzV1hqixjU7_vbIb33VHtTynJnnDTq045A9ctk4tA Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: bfe90c27e0e44c4794ccff00eac150ca Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 17:56:19.645679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfe90c27e0e44c4794ccff00eac150ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: bfe90c27e0e44c4794ccff00eac150ca Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-DeleteServersTestJSON-2047629068-project Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 07441f3b8a3841b0ba3677ec38fe7f32 Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-DeleteServersTestJSON-2047629068-project Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:19.647102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'b519c690-9e51-4863-89b4-ee2a3a5d8846'} Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:56:19.647812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:19.649056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:56:19.650832 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Returning 404 to user: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:56:19.650832 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3e165659-85b4-4ab2-8b12-94548a4dc178 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 404 len: 111 microversion: 2.1 time: 0.030407 Oct 14 17:56:19.650832 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 82/174] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 17:56:19 2022] DELETE /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 17:56:19.655295 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:19.655910 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] [instance: b519c690-9e51-4863-89b4-ee2a3a5d8846] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:19.662010 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:19.662482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:19.662905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:19.663579 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:19.664055 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:19.664528 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:19.680006 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] HTTP exception thrown: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Request method failure captured: Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 HTTP/1.1 Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaKClKPm9yqhNSZQqBF8l8xX45TM8gk2dRP4POHhN60Mpa5Yir767HOm_PJBfgLj3E5nDEHW1J5SewYHZPk9SFt9rxLuYP1DQZaZZl7yCzFwC5fCJanoBamxdrrDzG58jF82QtZzV1hqixjU7_vbIb33VHtTynJnnDTq045A9ctk4tA Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: bfe90c27e0e44c4794ccff00eac150ca Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 17:56:19.681494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfe90c27e0e44c4794ccff00eac150ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfe90c27e0e44c4794ccff00eac150ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: bfe90c27e0e44c4794ccff00eac150ca Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-DeleteServersTestJSON-2047629068 Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-DeleteServersTestJSON-2047629068-project Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 07441f3b8a3841b0ba3677ec38fe7f32 Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-DeleteServersTestJSON-2047629068-project Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:19.683602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'b519c690-9e51-4863-89b4-ee2a3a5d8846'} Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:56:19.684415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. Oct 14 17:56:19.685506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:19.686457 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] Returning 404 to user: Instance b519c690-9e51-4863-89b4-ee2a3a5d8846 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:56:19.686457 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-735f7d97-c9c8-4cfc-8006-6396b8c164f6 tempest-DeleteServersTestJSON-2047629068 tempest-DeleteServersTestJSON-2047629068-project] 10.222.0.27 "GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846" status: 404 len: 111 microversion: 2.1 time: 0.032212 Oct 14 17:56:19.686457 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 93/175] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:19 2022] GET /compute/v2.1/servers/b519c690-9e51-4863-89b4-ee2a3a5d8846 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 17:56:19.839729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5f14677d-2b53-4fbd-9463-60fa580f6c6d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:19.840571 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-5f14677d-2b53-4fbd-9463-60fa580f6c6d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:19.846558 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f14677d-2b53-4fbd-9463-60fa580f6c6d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:19.847229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f14677d-2b53-4fbd-9463-60fa580f6c6d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:19.847812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f14677d-2b53-4fbd-9463-60fa580f6c6d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:19.848673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f14677d-2b53-4fbd-9463-60fa580f6c6d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:19.849566 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f14677d-2b53-4fbd-9463-60fa580f6c6d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:19.850490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f14677d-2b53-4fbd-9463-60fa580f6c6d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:20.003088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5f14677d-2b53-4fbd-9463-60fa580f6c6d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:20.012915 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-5f14677d-2b53-4fbd-9463-60fa580f6c6d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.178180 Oct 14 17:56:20.013494 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 83/176] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:19 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:21.041107 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dbf83ae2-83c2-4fb1-9d8e-ef2c2d60b6f1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:21.042544 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-dbf83ae2-83c2-4fb1-9d8e-ef2c2d60b6f1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:21.049184 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf83ae2-83c2-4fb1-9d8e-ef2c2d60b6f1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:21.049634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf83ae2-83c2-4fb1-9d8e-ef2c2d60b6f1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:21.050060 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf83ae2-83c2-4fb1-9d8e-ef2c2d60b6f1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:21.050783 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf83ae2-83c2-4fb1-9d8e-ef2c2d60b6f1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:21.051226 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf83ae2-83c2-4fb1-9d8e-ef2c2d60b6f1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:21.051623 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf83ae2-83c2-4fb1-9d8e-ef2c2d60b6f1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:21.238651 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-dbf83ae2-83c2-4fb1-9d8e-ef2c2d60b6f1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:21.251623 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-dbf83ae2-83c2-4fb1-9d8e-ef2c2d60b6f1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.214561 Oct 14 17:56:21.252903 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 94/177] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:21 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:22.274699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e3aa54f0-1711-4f6a-a23c-6676a30283d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:22.275297 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e3aa54f0-1711-4f6a-a23c-6676a30283d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:22.284383 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3aa54f0-1711-4f6a-a23c-6676a30283d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:22.285096 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3aa54f0-1711-4f6a-a23c-6676a30283d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:22.285598 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3aa54f0-1711-4f6a-a23c-6676a30283d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:22.286376 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3aa54f0-1711-4f6a-a23c-6676a30283d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:22.286961 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3aa54f0-1711-4f6a-a23c-6676a30283d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:22.287490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3aa54f0-1711-4f6a-a23c-6676a30283d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:22.563216 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e3aa54f0-1711-4f6a-a23c-6676a30283d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:22.571853 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e3aa54f0-1711-4f6a-a23c-6676a30283d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.301030 Oct 14 17:56:22.573156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 84/178] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:22 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:23.595839 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-46ad0eda-172f-475b-aab9-83c565e41909 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:23.596578 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-46ad0eda-172f-475b-aab9-83c565e41909 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:23.602631 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-46ad0eda-172f-475b-aab9-83c565e41909 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:23.603111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-46ad0eda-172f-475b-aab9-83c565e41909 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:23.603548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-46ad0eda-172f-475b-aab9-83c565e41909 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:23.604284 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-46ad0eda-172f-475b-aab9-83c565e41909 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:23.604835 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-46ad0eda-172f-475b-aab9-83c565e41909 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:23.605262 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-46ad0eda-172f-475b-aab9-83c565e41909 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:23.800073 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-46ad0eda-172f-475b-aab9-83c565e41909 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:23.809429 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-46ad0eda-172f-475b-aab9-83c565e41909 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.217264 Oct 14 17:56:23.810036 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 95/179] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:23 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:24.833483 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d7fde443-28c1-4274-8a90-4746ae2cc8b3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:24.834307 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d7fde443-28c1-4274-8a90-4746ae2cc8b3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:24.841745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7fde443-28c1-4274-8a90-4746ae2cc8b3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:24.844933 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7fde443-28c1-4274-8a90-4746ae2cc8b3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:24.844933 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7fde443-28c1-4274-8a90-4746ae2cc8b3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:24.844933 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7fde443-28c1-4274-8a90-4746ae2cc8b3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:24.844933 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7fde443-28c1-4274-8a90-4746ae2cc8b3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:24.845521 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7fde443-28c1-4274-8a90-4746ae2cc8b3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:25.037792 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d7fde443-28c1-4274-8a90-4746ae2cc8b3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:25.046657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d7fde443-28c1-4274-8a90-4746ae2cc8b3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.216908 Oct 14 17:56:25.060313 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 85/180] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:24 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:26.071867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3b866ed1-e364-470d-8ea9-e45f7273aa79 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:26.073413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3b866ed1-e364-470d-8ea9-e45f7273aa79 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:26.083093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b866ed1-e364-470d-8ea9-e45f7273aa79 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:26.083669 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b866ed1-e364-470d-8ea9-e45f7273aa79 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:26.084150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b866ed1-e364-470d-8ea9-e45f7273aa79 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:26.084945 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b866ed1-e364-470d-8ea9-e45f7273aa79 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:26.085496 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b866ed1-e364-470d-8ea9-e45f7273aa79 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:26.086274 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3b866ed1-e364-470d-8ea9-e45f7273aa79 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:26.248634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3b866ed1-e364-470d-8ea9-e45f7273aa79 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:26.256315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3b866ed1-e364-470d-8ea9-e45f7273aa79 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.188353 Oct 14 17:56:26.256883 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 96/181] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:26 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:27.259300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-336499120", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:27.279953 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2fc7089a-e27e-4c81-8e1a-3cdff27ea17d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:27.280557 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2fc7089a-e27e-4c81-8e1a-3cdff27ea17d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:27.287595 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2fc7089a-e27e-4c81-8e1a-3cdff27ea17d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:27.288088 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2fc7089a-e27e-4c81-8e1a-3cdff27ea17d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:27.288712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2fc7089a-e27e-4c81-8e1a-3cdff27ea17d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:27.289431 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2fc7089a-e27e-4c81-8e1a-3cdff27ea17d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:27.289867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2fc7089a-e27e-4c81-8e1a-3cdff27ea17d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:27.290454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2fc7089a-e27e-4c81-8e1a-3cdff27ea17d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:27.313975 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.network.neutron [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] validate_networks() for None {{(pid=118656) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:56:27.615263 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2fc7089a-e27e-4c81-8e1a-3cdff27ea17d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:27.623264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2fc7089a-e27e-4c81-8e1a-3cdff27ea17d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.347869 Oct 14 17:56:27.623762 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 97/182] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:27 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:27.697204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Flavor limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:56:27.697692 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Image limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:56:27.698632 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Flavor pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:56:27.699257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Image pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:56:27.699840 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:56:27.715383 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:27.716146 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:27.716582 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:27.717088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:27.717543 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:27.717962 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:27.755021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Getting quotas for project e9854190f10741bc8636cec4604943d5. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:56:27.759284 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Getting quotas for user f676b3649fd04f699a5c5758fdc94017 and project e9854190f10741bc8636cec4604943d5. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:56:27.773622 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Going to run 1 instances... {{(pid=118656) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:56:27.776679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118656) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:56:27.829845 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a61dc454-c623-45f3-b11e-633175177b02 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574117 Oct 14 17:56:27.836361 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 86/183] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 17:56:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 17:56:27.841441 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-904d718a-e61f-4ec9-b185-67d506cd53be tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:27.842104 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-904d718a-e61f-4ec9-b185-67d506cd53be tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:27.900728 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-904d718a-e61f-4ec9-b185-67d506cd53be tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:27.910384 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-904d718a-e61f-4ec9-b185-67d506cd53be tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1214 microversion: 2.1 time: 0.072717 Oct 14 17:56:27.911755 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 98/184] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:27 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:28.645855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-56a5de69-9222-4b31-9a62-11c5a5d32f1b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:28.646497 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-56a5de69-9222-4b31-9a62-11c5a5d32f1b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:28.654330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-56a5de69-9222-4b31-9a62-11c5a5d32f1b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:28.654816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-56a5de69-9222-4b31-9a62-11c5a5d32f1b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:28.655243 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-56a5de69-9222-4b31-9a62-11c5a5d32f1b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:28.655966 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-56a5de69-9222-4b31-9a62-11c5a5d32f1b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:28.656407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-56a5de69-9222-4b31-9a62-11c5a5d32f1b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:28.656825 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-56a5de69-9222-4b31-9a62-11c5a5d32f1b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:28.799414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-56a5de69-9222-4b31-9a62-11c5a5d32f1b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:28.807739 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-56a5de69-9222-4b31-9a62-11c5a5d32f1b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.165203 Oct 14 17:56:28.808329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 87/185] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:28 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:28.934080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e4f97eaa-5ea0-48aa-af69-9e2ac22b862d tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:28.935264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e4f97eaa-5ea0-48aa-af69-9e2ac22b862d tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:28.941053 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4f97eaa-5ea0-48aa-af69-9e2ac22b862d tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:28.941539 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4f97eaa-5ea0-48aa-af69-9e2ac22b862d tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:28.941967 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4f97eaa-5ea0-48aa-af69-9e2ac22b862d tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:28.942659 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4f97eaa-5ea0-48aa-af69-9e2ac22b862d tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:28.943104 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4f97eaa-5ea0-48aa-af69-9e2ac22b862d tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:28.943523 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4f97eaa-5ea0-48aa-af69-9e2ac22b862d tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:29.012950 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e4f97eaa-5ea0-48aa-af69-9e2ac22b862d tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:29.022281 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e4f97eaa-5ea0-48aa-af69-9e2ac22b862d tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1266 microversion: 2.1 time: 0.092568 Oct 14 17:56:29.023304 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 99/186] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:28 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:29.830757 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2560e51a-1e31-41b6-8163-1c51ee522ad7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:29.831368 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2560e51a-1e31-41b6-8163-1c51ee522ad7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:29.839378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2560e51a-1e31-41b6-8163-1c51ee522ad7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:29.840115 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2560e51a-1e31-41b6-8163-1c51ee522ad7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:29.840573 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2560e51a-1e31-41b6-8163-1c51ee522ad7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:29.841258 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2560e51a-1e31-41b6-8163-1c51ee522ad7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:29.841701 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2560e51a-1e31-41b6-8163-1c51ee522ad7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:29.842399 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2560e51a-1e31-41b6-8163-1c51ee522ad7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:30.046174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7f22665a-09ba-4287-9503-10de14f69af9 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:30.046785 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7f22665a-09ba-4287-9503-10de14f69af9 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:30.052706 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7f22665a-09ba-4287-9503-10de14f69af9 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:30.053193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7f22665a-09ba-4287-9503-10de14f69af9 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:30.053627 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7f22665a-09ba-4287-9503-10de14f69af9 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:30.054318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7f22665a-09ba-4287-9503-10de14f69af9 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:30.054772 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7f22665a-09ba-4287-9503-10de14f69af9 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:30.055193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7f22665a-09ba-4287-9503-10de14f69af9 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:30.087561 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2560e51a-1e31-41b6-8163-1c51ee522ad7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:30.096471 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2560e51a-1e31-41b6-8163-1c51ee522ad7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.269560 Oct 14 17:56:30.097045 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 88/187] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:29 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:30.537271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7f22665a-09ba-4287-9503-10de14f69af9 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:30.546851 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7f22665a-09ba-4287-9503-10de14f69af9 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1314 microversion: 2.1 time: 0.504339 Oct 14 17:56:30.547630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 100/188] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:30 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:31.121625 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d0e17e5b-b154-4795-902d-bd43a3300c36 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:31.122343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d0e17e5b-b154-4795-902d-bd43a3300c36 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:31.128314 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d0e17e5b-b154-4795-902d-bd43a3300c36 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:31.128872 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d0e17e5b-b154-4795-902d-bd43a3300c36 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:31.129371 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d0e17e5b-b154-4795-902d-bd43a3300c36 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:31.130128 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d0e17e5b-b154-4795-902d-bd43a3300c36 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:31.130677 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d0e17e5b-b154-4795-902d-bd43a3300c36 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:31.131141 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d0e17e5b-b154-4795-902d-bd43a3300c36 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:31.260731 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d0e17e5b-b154-4795-902d-bd43a3300c36 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:31.268327 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d0e17e5b-b154-4795-902d-bd43a3300c36 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.151394 Oct 14 17:56:31.268899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 89/189] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:31 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:31.569481 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-90db417e-1356-4323-8ba5-fd56b95b0ece tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:31.570024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-90db417e-1356-4323-8ba5-fd56b95b0ece tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:31.576736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90db417e-1356-4323-8ba5-fd56b95b0ece tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:31.577313 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90db417e-1356-4323-8ba5-fd56b95b0ece tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:31.577940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90db417e-1356-4323-8ba5-fd56b95b0ece tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:31.578823 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90db417e-1356-4323-8ba5-fd56b95b0ece tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:31.579359 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90db417e-1356-4323-8ba5-fd56b95b0ece tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:31.579781 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90db417e-1356-4323-8ba5-fd56b95b0ece tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:31.817207 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-90db417e-1356-4323-8ba5-fd56b95b0ece tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:31.825781 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-90db417e-1356-4323-8ba5-fd56b95b0ece tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1314 microversion: 2.1 time: 0.260143 Oct 14 17:56:31.826279 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 101/190] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:31 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:32.293839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-48eebeeb-30eb-4e99-89e5-d6bcf67f1d3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:32.294443 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-48eebeeb-30eb-4e99-89e5-d6bcf67f1d3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:32.301874 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48eebeeb-30eb-4e99-89e5-d6bcf67f1d3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:32.302736 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48eebeeb-30eb-4e99-89e5-d6bcf67f1d3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:32.303412 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48eebeeb-30eb-4e99-89e5-d6bcf67f1d3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:32.304319 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48eebeeb-30eb-4e99-89e5-d6bcf67f1d3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:32.304775 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48eebeeb-30eb-4e99-89e5-d6bcf67f1d3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:32.305200 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48eebeeb-30eb-4e99-89e5-d6bcf67f1d3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:32.384734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-16dd7bf1-fd45-48bf-82c4-62b3b66595ad req-97e4c0e2-61f6-41df-bdbd-e2cb86e05e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be6cbd3-0eb4-49d2-be26-52c4babb03e8", "tag": "6db5d64a-ebe0-4b61-b609-4df5d4052013"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:32.395291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:32.402867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-16dd7bf1-fd45-48bf-82c4-62b3b66595ad req-97e4c0e2-61f6-41df-bdbd-e2cb86e05e0c service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:32.403344 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-16dd7bf1-fd45-48bf-82c4-62b3b66595ad req-97e4c0e2-61f6-41df-bdbd-e2cb86e05e0c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:32.403770 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-16dd7bf1-fd45-48bf-82c4-62b3b66595ad req-97e4c0e2-61f6-41df-bdbd-e2cb86e05e0c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:32.416568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-16dd7bf1-fd45-48bf-82c4-62b3b66595ad req-97e4c0e2-61f6-41df-bdbd-e2cb86e05e0c service nova] Creating event network-changed:6db5d64a-ebe0-4b61-b609-4df5d4052013 for instance 5be6cbd3-0eb4-49d2-be26-52c4babb03e8 on hv-cinder-74915 Oct 14 17:56:32.422862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-16dd7bf1-fd45-48bf-82c4-62b3b66595ad req-97e4c0e2-61f6-41df-bdbd-e2cb86e05e0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042585 Oct 14 17:56:32.423623 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 102/191] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 17:56:32.501181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-48eebeeb-30eb-4e99-89e5-d6bcf67f1d3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:32.508910 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-48eebeeb-30eb-4e99-89e5-d6bcf67f1d3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.219888 Oct 14 17:56:32.509609 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 90/192] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:32 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:32.849494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5ec5bf8a-2d0d-44fb-9a4b-16d2e6266b3b tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:32.850188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5ec5bf8a-2d0d-44fb-9a4b-16d2e6266b3b tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:32.859937 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ec5bf8a-2d0d-44fb-9a4b-16d2e6266b3b tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:32.860389 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ec5bf8a-2d0d-44fb-9a4b-16d2e6266b3b tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:32.860817 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ec5bf8a-2d0d-44fb-9a4b-16d2e6266b3b tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:32.861514 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ec5bf8a-2d0d-44fb-9a4b-16d2e6266b3b tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:32.872350 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ec5bf8a-2d0d-44fb-9a4b-16d2e6266b3b tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:32.872847 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ec5bf8a-2d0d-44fb-9a4b-16d2e6266b3b tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:33.120978 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5ec5bf8a-2d0d-44fb-9a4b-16d2e6266b3b tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:33.129247 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5ec5bf8a-2d0d-44fb-9a4b-16d2e6266b3b tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1314 microversion: 2.1 time: 0.284445 Oct 14 17:56:33.146046 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 103/193] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:32 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:33.531745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-34a8cc40-1733-44db-ad27-28c2b8aa152b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:33.532382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-34a8cc40-1733-44db-ad27-28c2b8aa152b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:33.539051 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34a8cc40-1733-44db-ad27-28c2b8aa152b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:33.539526 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34a8cc40-1733-44db-ad27-28c2b8aa152b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:33.539989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34a8cc40-1733-44db-ad27-28c2b8aa152b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:33.540672 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34a8cc40-1733-44db-ad27-28c2b8aa152b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:33.541370 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34a8cc40-1733-44db-ad27-28c2b8aa152b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:33.541803 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34a8cc40-1733-44db-ad27-28c2b8aa152b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:33.672169 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-34a8cc40-1733-44db-ad27-28c2b8aa152b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:33.679852 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-34a8cc40-1733-44db-ad27-28c2b8aa152b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.151929 Oct 14 17:56:33.680428 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 91/194] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:33 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:34.154238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7344b694-004d-47da-9764-fb4fc049ee83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:34.155354 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7344b694-004d-47da-9764-fb4fc049ee83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:34.161574 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7344b694-004d-47da-9764-fb4fc049ee83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:34.162029 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7344b694-004d-47da-9764-fb4fc049ee83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:34.162451 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7344b694-004d-47da-9764-fb4fc049ee83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:34.163126 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7344b694-004d-47da-9764-fb4fc049ee83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:34.163564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7344b694-004d-47da-9764-fb4fc049ee83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:34.164006 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7344b694-004d-47da-9764-fb4fc049ee83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:34.294589 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7344b694-004d-47da-9764-fb4fc049ee83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:34.303151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7344b694-004d-47da-9764-fb4fc049ee83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1314 microversion: 2.1 time: 0.153432 Oct 14 17:56:34.303732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 104/195] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:34 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:34.703892 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f7c62ff6-9634-48be-bc2b-e215b15b267f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:34.704911 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f7c62ff6-9634-48be-bc2b-e215b15b267f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:34.711365 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f7c62ff6-9634-48be-bc2b-e215b15b267f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:34.711984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f7c62ff6-9634-48be-bc2b-e215b15b267f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:34.712590 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f7c62ff6-9634-48be-bc2b-e215b15b267f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:34.714221 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f7c62ff6-9634-48be-bc2b-e215b15b267f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:34.715081 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f7c62ff6-9634-48be-bc2b-e215b15b267f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:34.715807 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f7c62ff6-9634-48be-bc2b-e215b15b267f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:34.858752 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f7c62ff6-9634-48be-bc2b-e215b15b267f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:34.867608 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f7c62ff6-9634-48be-bc2b-e215b15b267f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.168192 Oct 14 17:56:34.868321 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 92/196] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:34 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:35.325734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-94314fb5-4288-4307-b163-02f63d7bab01 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:35.326339 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-94314fb5-4288-4307-b163-02f63d7bab01 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:35.332152 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94314fb5-4288-4307-b163-02f63d7bab01 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:35.332627 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94314fb5-4288-4307-b163-02f63d7bab01 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:35.333053 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94314fb5-4288-4307-b163-02f63d7bab01 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:35.333732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94314fb5-4288-4307-b163-02f63d7bab01 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:35.334180 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94314fb5-4288-4307-b163-02f63d7bab01 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:35.334596 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94314fb5-4288-4307-b163-02f63d7bab01 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:35.460144 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-94314fb5-4288-4307-b163-02f63d7bab01 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:35.468356 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-94314fb5-4288-4307-b163-02f63d7bab01 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1314 microversion: 2.1 time: 0.146604 Oct 14 17:56:35.468912 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 105/197] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:35 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:35.891408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1ff146ab-4e90-4a49-a840-ae0dff1e04c1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:35.892571 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1ff146ab-4e90-4a49-a840-ae0dff1e04c1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:35.895006 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:35.900231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ff146ab-4e90-4a49-a840-ae0dff1e04c1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:35.900713 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ff146ab-4e90-4a49-a840-ae0dff1e04c1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:35.901139 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ff146ab-4e90-4a49-a840-ae0dff1e04c1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:35.901857 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ff146ab-4e90-4a49-a840-ae0dff1e04c1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:35.902301 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ff146ab-4e90-4a49-a840-ae0dff1e04c1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:35.902718 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ff146ab-4e90-4a49-a840-ae0dff1e04c1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:36.043266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1ff146ab-4e90-4a49-a840-ae0dff1e04c1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:36.053323 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1ff146ab-4e90-4a49-a840-ae0dff1e04c1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.166082 Oct 14 17:56:36.056112 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 93/198] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:35 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:36.490677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9afaa8a9-9365-441f-9ed3-4fdcf690d053 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:36.491290 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9afaa8a9-9365-441f-9ed3-4fdcf690d053 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:36.498150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9afaa8a9-9365-441f-9ed3-4fdcf690d053 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:36.498634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9afaa8a9-9365-441f-9ed3-4fdcf690d053 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:36.499066 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9afaa8a9-9365-441f-9ed3-4fdcf690d053 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:36.500059 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9afaa8a9-9365-441f-9ed3-4fdcf690d053 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:36.500657 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9afaa8a9-9365-441f-9ed3-4fdcf690d053 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:36.501087 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9afaa8a9-9365-441f-9ed3-4fdcf690d053 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:36.645259 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9afaa8a9-9365-441f-9ed3-4fdcf690d053 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:36.655690 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9afaa8a9-9365-441f-9ed3-4fdcf690d053 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1314 microversion: 2.1 time: 0.168830 Oct 14 17:56:36.656553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 106/199] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:36 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:36.901184 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-9842c507-119b-48db-af17-9d581a851ac2 req-b341c904-743e-446e-b12d-9716af0a8311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be6cbd3-0eb4-49d2-be26-52c4babb03e8", "name": "network-vif-plugged", "status": "completed", "tag": "6db5d64a-ebe0-4b61-b609-4df5d4052013"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:36.913020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-9842c507-119b-48db-af17-9d581a851ac2 req-b341c904-743e-446e-b12d-9716af0a8311 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:36.913475 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-9842c507-119b-48db-af17-9d581a851ac2 req-b341c904-743e-446e-b12d-9716af0a8311 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:36.913938 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-9842c507-119b-48db-af17-9d581a851ac2 req-b341c904-743e-446e-b12d-9716af0a8311 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:36.926010 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-9842c507-119b-48db-af17-9d581a851ac2 req-b341c904-743e-446e-b12d-9716af0a8311 service nova] Creating event network-vif-plugged:6db5d64a-ebe0-4b61-b609-4df5d4052013 for instance 5be6cbd3-0eb4-49d2-be26-52c4babb03e8 on hv-cinder-74915 Oct 14 17:56:36.931408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-9842c507-119b-48db-af17-9d581a851ac2 req-b341c904-743e-446e-b12d-9716af0a8311 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035627 Oct 14 17:56:36.932175 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 94/200] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:37.079465 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-15d0d1ae-9762-45e6-87f6-9770128e889e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:37.080331 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-15d0d1ae-9762-45e6-87f6-9770128e889e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:37.086201 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-15d0d1ae-9762-45e6-87f6-9770128e889e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:37.086678 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-15d0d1ae-9762-45e6-87f6-9770128e889e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:37.087112 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-15d0d1ae-9762-45e6-87f6-9770128e889e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:37.087795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-15d0d1ae-9762-45e6-87f6-9770128e889e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:37.088759 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-15d0d1ae-9762-45e6-87f6-9770128e889e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:37.088759 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-15d0d1ae-9762-45e6-87f6-9770128e889e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:37.223399 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-15d0d1ae-9762-45e6-87f6-9770128e889e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:37.233205 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-15d0d1ae-9762-45e6-87f6-9770128e889e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.157625 Oct 14 17:56:37.236596 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 107/201] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:37 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:37.679485 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e2f93394-d8b4-4977-852c-66d3d16d008a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:37.680205 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e2f93394-d8b4-4977-852c-66d3d16d008a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:37.686326 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e2f93394-d8b4-4977-852c-66d3d16d008a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:37.687007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e2f93394-d8b4-4977-852c-66d3d16d008a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:37.687426 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e2f93394-d8b4-4977-852c-66d3d16d008a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:37.688183 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e2f93394-d8b4-4977-852c-66d3d16d008a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:37.688602 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e2f93394-d8b4-4977-852c-66d3d16d008a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:37.689192 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e2f93394-d8b4-4977-852c-66d3d16d008a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:37.746838 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:37.767461 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=6 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:37.828892 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e2f93394-d8b4-4977-852c-66d3d16d008a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:37.838160 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e2f93394-d8b4-4977-852c-66d3d16d008a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1314 microversion: 2.1 time: 0.162890 Oct 14 17:56:37.838943 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 95/202] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:37 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:38.256458 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0ff9463e-d118-442c-93d5-7c46d03bad30 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:38.257093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0ff9463e-d118-442c-93d5-7c46d03bad30 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:38.259051 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:38.265237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ff9463e-d118-442c-93d5-7c46d03bad30 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:38.265721 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ff9463e-d118-442c-93d5-7c46d03bad30 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:38.266153 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ff9463e-d118-442c-93d5-7c46d03bad30 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:38.266848 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ff9463e-d118-442c-93d5-7c46d03bad30 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:38.267299 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ff9463e-d118-442c-93d5-7c46d03bad30 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:38.267819 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0ff9463e-d118-442c-93d5-7c46d03bad30 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:38.478764 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0ff9463e-d118-442c-93d5-7c46d03bad30 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:38.490598 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0ff9463e-d118-442c-93d5-7c46d03bad30 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.237628 Oct 14 17:56:38.491739 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 108/203] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:38 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:38.861976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e205e4ab-7c21-49e4-8892-2ca3b40c6d78 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:38.862497 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e205e4ab-7c21-49e4-8892-2ca3b40c6d78 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:38.869156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e205e4ab-7c21-49e4-8892-2ca3b40c6d78 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:38.869730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e205e4ab-7c21-49e4-8892-2ca3b40c6d78 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:38.871087 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e205e4ab-7c21-49e4-8892-2ca3b40c6d78 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:38.872271 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e205e4ab-7c21-49e4-8892-2ca3b40c6d78 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:38.872795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e205e4ab-7c21-49e4-8892-2ca3b40c6d78 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:38.873462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e205e4ab-7c21-49e4-8892-2ca3b40c6d78 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:39.027558 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e205e4ab-7c21-49e4-8892-2ca3b40c6d78 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:39.043981 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e205e4ab-7c21-49e4-8892-2ca3b40c6d78 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1314 microversion: 2.1 time: 0.185804 Oct 14 17:56:39.044959 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 96/204] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:38 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:39.513588 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-16cc910c-0b12-4c02-bd2e-50b4daeb5a68 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:39.514197 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-16cc910c-0b12-4c02-bd2e-50b4daeb5a68 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:39.521962 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-16cc910c-0b12-4c02-bd2e-50b4daeb5a68 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:39.522439 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-16cc910c-0b12-4c02-bd2e-50b4daeb5a68 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:39.522867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-16cc910c-0b12-4c02-bd2e-50b4daeb5a68 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:39.523552 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-16cc910c-0b12-4c02-bd2e-50b4daeb5a68 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:39.524101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-16cc910c-0b12-4c02-bd2e-50b4daeb5a68 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:39.524460 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-16cc910c-0b12-4c02-bd2e-50b4daeb5a68 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:39.662541 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-16cc910c-0b12-4c02-bd2e-50b4daeb5a68 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:39.670832 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-16cc910c-0b12-4c02-bd2e-50b4daeb5a68 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1521 microversion: 2.1 time: 0.161704 Oct 14 17:56:39.671760 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 109/205] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:39 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:40.068448 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a308b7e7-a8c9-4426-b578-ec7c74684897 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:40.069353 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a308b7e7-a8c9-4426-b578-ec7c74684897 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:40.077293 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a308b7e7-a8c9-4426-b578-ec7c74684897 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:40.078018 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a308b7e7-a8c9-4426-b578-ec7c74684897 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:40.078602 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a308b7e7-a8c9-4426-b578-ec7c74684897 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:40.079297 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a308b7e7-a8c9-4426-b578-ec7c74684897 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:40.079908 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a308b7e7-a8c9-4426-b578-ec7c74684897 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:40.080338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a308b7e7-a8c9-4426-b578-ec7c74684897 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:40.247217 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a308b7e7-a8c9-4426-b578-ec7c74684897 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:40.254697 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a308b7e7-a8c9-4426-b578-ec7c74684897 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1464 microversion: 2.1 time: 0.191291 Oct 14 17:56:40.255250 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 97/206] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:40 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1464 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:40.301341 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3bbdf138-b062-4615-a098-59205e9e49ea tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:40.301833 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3bbdf138-b062-4615-a098-59205e9e49ea tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:40.308785 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bbdf138-b062-4615-a098-59205e9e49ea tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:40.309542 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bbdf138-b062-4615-a098-59205e9e49ea tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:40.310177 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bbdf138-b062-4615-a098-59205e9e49ea tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:40.314488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bbdf138-b062-4615-a098-59205e9e49ea tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:40.314488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bbdf138-b062-4615-a098-59205e9e49ea tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:40.314488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3bbdf138-b062-4615-a098-59205e9e49ea tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:40.337146 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3bbdf138-b062-4615-a098-59205e9e49ea tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 17:56:40.339914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=100 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:40.417171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3bbdf138-b062-4615-a098-59205e9e49ea tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 204 len: 0 microversion: 2.1 time: 0.119340 Oct 14 17:56:40.417949 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 110/207] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 17:56:40 2022] DELETE /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 17:56:40.426399 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-dd69858a-48f3-4109-99ca-882a30c6bc83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:40.427005 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-dd69858a-48f3-4109-99ca-882a30c6bc83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:40.433416 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd69858a-48f3-4109-99ca-882a30c6bc83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:40.433910 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd69858a-48f3-4109-99ca-882a30c6bc83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:40.434337 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd69858a-48f3-4109-99ca-882a30c6bc83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:40.435017 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd69858a-48f3-4109-99ca-882a30c6bc83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:40.435461 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd69858a-48f3-4109-99ca-882a30c6bc83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:40.437735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd69858a-48f3-4109-99ca-882a30c6bc83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:40.572571 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-dd69858a-48f3-4109-99ca-882a30c6bc83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:40.581180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-dd69858a-48f3-4109-99ca-882a30c6bc83 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1470 microversion: 2.1 time: 0.158656 Oct 14 17:56:40.581915 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 98/208] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:40 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:40.695104 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4405efe7-61b7-448e-bbf6-06fcda5e6578 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:40.695729 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4405efe7-61b7-448e-bbf6-06fcda5e6578 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:40.702365 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4405efe7-61b7-448e-bbf6-06fcda5e6578 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:40.702840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4405efe7-61b7-448e-bbf6-06fcda5e6578 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:40.703658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4405efe7-61b7-448e-bbf6-06fcda5e6578 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:40.704814 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4405efe7-61b7-448e-bbf6-06fcda5e6578 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:40.705493 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4405efe7-61b7-448e-bbf6-06fcda5e6578 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:40.706170 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4405efe7-61b7-448e-bbf6-06fcda5e6578 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:40.845189 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4405efe7-61b7-448e-bbf6-06fcda5e6578 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:40.852860 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4405efe7-61b7-448e-bbf6-06fcda5e6578 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1501 microversion: 2.1 time: 0.162973 Oct 14 17:56:40.853422 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 111/209] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:40 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:40.875540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-91ad34f6-86eb-4ba7-a179-9bdb4a9f375c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:40.876176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-91ad34f6-86eb-4ba7-a179-9bdb4a9f375c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:40.881976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-91ad34f6-86eb-4ba7-a179-9bdb4a9f375c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:40.882474 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-91ad34f6-86eb-4ba7-a179-9bdb4a9f375c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:40.882890 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-91ad34f6-86eb-4ba7-a179-9bdb4a9f375c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:40.883570 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-91ad34f6-86eb-4ba7-a179-9bdb4a9f375c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:40.884123 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-91ad34f6-86eb-4ba7-a179-9bdb4a9f375c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:40.884547 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-91ad34f6-86eb-4ba7-a179-9bdb4a9f375c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:40.888809 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=100 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:41.009538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-91ad34f6-86eb-4ba7-a179-9bdb4a9f375c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:41.017803 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-91ad34f6-86eb-4ba7-a179-9bdb4a9f375c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1515 microversion: 2.1 time: 0.145984 Oct 14 17:56:41.018363 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 99/210] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:40 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:41.604869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bb1a16c5-26e0-4e00-bb75-6e5d6e7f1522 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:41.605483 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bb1a16c5-26e0-4e00-bb75-6e5d6e7f1522 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:41.611361 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb1a16c5-26e0-4e00-bb75-6e5d6e7f1522 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:41.611835 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb1a16c5-26e0-4e00-bb75-6e5d6e7f1522 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:41.612297 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb1a16c5-26e0-4e00-bb75-6e5d6e7f1522 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:41.612979 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb1a16c5-26e0-4e00-bb75-6e5d6e7f1522 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:41.613428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb1a16c5-26e0-4e00-bb75-6e5d6e7f1522 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:41.613850 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb1a16c5-26e0-4e00-bb75-6e5d6e7f1522 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:41.748868 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bb1a16c5-26e0-4e00-bb75-6e5d6e7f1522 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:41.757228 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bb1a16c5-26e0-4e00-bb75-6e5d6e7f1522 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1470 microversion: 2.1 time: 0.156417 Oct 14 17:56:41.757821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 112/211] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:41 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:42.394591 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d2d1a898-af7d-4382-bbec-d91d2f1cf9b8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:42.396934 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d2d1a898-af7d-4382-bbec-d91d2f1cf9b8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:42.403411 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d2d1a898-af7d-4382-bbec-d91d2f1cf9b8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:42.403921 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d2d1a898-af7d-4382-bbec-d91d2f1cf9b8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:42.404358 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d2d1a898-af7d-4382-bbec-d91d2f1cf9b8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:42.405050 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d2d1a898-af7d-4382-bbec-d91d2f1cf9b8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:42.405500 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d2d1a898-af7d-4382-bbec-d91d2f1cf9b8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:42.405924 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d2d1a898-af7d-4382-bbec-d91d2f1cf9b8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:42.429173 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-d2d1a898-af7d-4382-bbec-d91d2f1cf9b8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lazy-loading 'flavor' on Instance uuid 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:56:42.544973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d2d1a898-af7d-4382-bbec-d91d2f1cf9b8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a/action" status: 200 len: 32 microversion: 2.1 time: 0.153795 Oct 14 17:56:42.545666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 100/212] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:56:42 2022] POST /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a/action => generated 32 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 17:56:42.555906 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-17c6d380-eb05-452b-8efe-a40bae4978f6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:42.556067 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-17c6d380-eb05-452b-8efe-a40bae4978f6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:42.563353 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-17c6d380-eb05-452b-8efe-a40bae4978f6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:42.563930 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-17c6d380-eb05-452b-8efe-a40bae4978f6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:42.564363 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-17c6d380-eb05-452b-8efe-a40bae4978f6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:42.565057 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-17c6d380-eb05-452b-8efe-a40bae4978f6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:42.566420 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-17c6d380-eb05-452b-8efe-a40bae4978f6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:42.567266 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-17c6d380-eb05-452b-8efe-a40bae4978f6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:42.782745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7bbf8be1-8b98-415d-b1a9-4b6c6d53a41a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:42.783912 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7bbf8be1-8b98-415d-b1a9-4b6c6d53a41a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:42.790811 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7bbf8be1-8b98-415d-b1a9-4b6c6d53a41a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:42.791541 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7bbf8be1-8b98-415d-b1a9-4b6c6d53a41a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:42.792000 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7bbf8be1-8b98-415d-b1a9-4b6c6d53a41a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:42.793430 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7bbf8be1-8b98-415d-b1a9-4b6c6d53a41a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:42.794071 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7bbf8be1-8b98-415d-b1a9-4b6c6d53a41a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:42.794708 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7bbf8be1-8b98-415d-b1a9-4b6c6d53a41a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:42.928577 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-17c6d380-eb05-452b-8efe-a40bae4978f6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:42.946104 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-17c6d380-eb05-452b-8efe-a40bae4978f6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.394343 Oct 14 17:56:42.956880 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 113/213] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:42 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:43.344174 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7bbf8be1-8b98-415d-b1a9-4b6c6d53a41a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:43.352182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7bbf8be1-8b98-415d-b1a9-4b6c6d53a41a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1470 microversion: 2.1 time: 0.574017 Oct 14 17:56:43.352389 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 101/214] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:42 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1470 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:43.556468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-b43c8768-28f7-45f0-8185-71c8343ce222 req-e344a97a-dced-4016-9bf4-ae01b39c93a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be6cbd3-0eb4-49d2-be26-52c4babb03e8", "name": "network-vif-deleted", "tag": "6db5d64a-ebe0-4b61-b609-4df5d4052013"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:43.576765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-b43c8768-28f7-45f0-8185-71c8343ce222 req-e344a97a-dced-4016-9bf4-ae01b39c93a7 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:43.577723 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-b43c8768-28f7-45f0-8185-71c8343ce222 req-e344a97a-dced-4016-9bf4-ae01b39c93a7 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:43.578748 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-b43c8768-28f7-45f0-8185-71c8343ce222 req-e344a97a-dced-4016-9bf4-ae01b39c93a7 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:43.603797 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-b43c8768-28f7-45f0-8185-71c8343ce222 req-e344a97a-dced-4016-9bf4-ae01b39c93a7 service nova] Creating event network-vif-deleted:6db5d64a-ebe0-4b61-b609-4df5d4052013 for instance 5be6cbd3-0eb4-49d2-be26-52c4babb03e8 on hv-cinder-74915 Oct 14 17:56:43.610865 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-b43c8768-28f7-45f0-8185-71c8343ce222 req-e344a97a-dced-4016-9bf4-ae01b39c93a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057567 Oct 14 17:56:43.611977 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 114/215] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:43.977202 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0ad1b7d4-e662-45bf-a113-3e9d188bb534 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:43.977922 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0ad1b7d4-e662-45bf-a113-3e9d188bb534 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:43.985144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0ad1b7d4-e662-45bf-a113-3e9d188bb534 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:43.985626 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0ad1b7d4-e662-45bf-a113-3e9d188bb534 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:43.986045 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0ad1b7d4-e662-45bf-a113-3e9d188bb534 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:43.986838 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0ad1b7d4-e662-45bf-a113-3e9d188bb534 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:43.987274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0ad1b7d4-e662-45bf-a113-3e9d188bb534 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:43.987700 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0ad1b7d4-e662-45bf-a113-3e9d188bb534 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:44.129400 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0ad1b7d4-e662-45bf-a113-3e9d188bb534 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:44.137723 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0ad1b7d4-e662-45bf-a113-3e9d188bb534 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.164432 Oct 14 17:56:44.138541 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 102/216] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:43 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:44.383802 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:44.384743 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:44.394248 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:44.396218 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:44.396813 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:44.397915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:44.400251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:44.401340 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:44.445030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:44.445959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:44.446704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:44.447232 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lazy-loading 'fault' on Instance uuid 5be6cbd3-0eb4-49d2-be26-52c4babb03e8 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:56:44.497867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f676b3649fd04f699a5c5758fdc94017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9854190f10741bc8636cec4604943d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:44.506623 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0c3bf49e-bce2-4118-9bd0-a137d642993a tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 200 len: 1304 microversion: 2.1 time: 0.135654 Oct 14 17:56:44.507448 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 115/217] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:44 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:45.162098 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b6c5fa1b-d2c7-4e18-b246-5413d9032fd1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:45.162700 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b6c5fa1b-d2c7-4e18-b246-5413d9032fd1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:45.182229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6c5fa1b-d2c7-4e18-b246-5413d9032fd1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:45.182781 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6c5fa1b-d2c7-4e18-b246-5413d9032fd1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:45.183758 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6c5fa1b-d2c7-4e18-b246-5413d9032fd1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:45.184659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6c5fa1b-d2c7-4e18-b246-5413d9032fd1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:45.185110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6c5fa1b-d2c7-4e18-b246-5413d9032fd1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:45.185528 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b6c5fa1b-d2c7-4e18-b246-5413d9032fd1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:45.333331 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b6c5fa1b-d2c7-4e18-b246-5413d9032fd1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:45.336172 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b6c5fa1b-d2c7-4e18-b246-5413d9032fd1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.178040 Oct 14 17:56:45.336823 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 103/218] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:45 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:45.532862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:45.533472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] [instance: 5be6cbd3-0eb4-49d2-be26-52c4babb03e8] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:45.540022 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:45.540506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:45.540936 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:45.541624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:45.542131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:45.543047 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:45.557482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] HTTP exception thrown: Instance 5be6cbd3-0eb4-49d2-be26-52c4babb03e8 could not be found. Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Request method failure captured: Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 HTTP/1.1 Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaLJFliC9248VXSWNtudARyVITaSTUBsoafkdGl9onLhXvKs9pUN_jc-egDpYo17hm4m8kKjD0I7qIRsXZ7uJE3YE1Y4rZkYArt6I-N3cbzUYfsej5osSDDNll5TXx1azz_k_y5w6cqXI1shjrA-AewLZo734kkC5Kgi1d9ZXQVNk98 Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: e9854190f10741bc8636cec4604943d5 Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-VolumesNegativeTest-263491173 Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 17:56:45.559238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9854190f10741bc8636cec4604943d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9854190f10741bc8636cec4604943d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9854190f10741bc8636cec4604943d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9854190f10741bc8636cec4604943d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-VolumesNegativeTest-263491173 Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: e9854190f10741bc8636cec4604943d5 Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-VolumesNegativeTest-263491173 Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-VolumesNegativeTest-263491173-project Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: f676b3649fd04f699a5c5758fdc94017 Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-VolumesNegativeTest-263491173-project Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 5be6cbd3-0eb4-49d2-be26-52c4babb03e8 could not be found. Oct 14 17:56:45.560736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '5be6cbd3-0eb4-49d2-be26-52c4babb03e8'} Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be6cbd3-0eb4-49d2-be26-52c4babb03e8 could not be found. Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:56:45.561570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be6cbd3-0eb4-49d2-be26-52c4babb03e8 could not be found. Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be6cbd3-0eb4-49d2-be26-52c4babb03e8 could not be found. Oct 14 17:56:45.562665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:56:45.563668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] Returning 404 to user: Instance 5be6cbd3-0eb4-49d2-be26-52c4babb03e8 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:56:45.563668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b4f0bca4-8132-4b38-8de6-f226aa777005 tempest-VolumesNegativeTest-263491173 tempest-VolumesNegativeTest-263491173-project] 10.222.0.27 "GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8" status: 404 len: 111 microversion: 2.1 time: 0.034079 Oct 14 17:56:45.563668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 116/219] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:45 2022] GET /compute/v2.1/servers/5be6cbd3-0eb4-49d2-be26-52c4babb03e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 17:56:46.360745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-86294b50-98db-4f0d-835c-773113ba8196 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:46.361444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-86294b50-98db-4f0d-835c-773113ba8196 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:46.369961 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-86294b50-98db-4f0d-835c-773113ba8196 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:46.371204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-86294b50-98db-4f0d-835c-773113ba8196 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:46.371869 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-86294b50-98db-4f0d-835c-773113ba8196 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:46.372572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-86294b50-98db-4f0d-835c-773113ba8196 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:46.373025 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-86294b50-98db-4f0d-835c-773113ba8196 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:46.373452 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-86294b50-98db-4f0d-835c-773113ba8196 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:46.721913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-86294b50-98db-4f0d-835c-773113ba8196 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:46.730742 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-86294b50-98db-4f0d-835c-773113ba8196 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.373238 Oct 14 17:56:46.731193 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 104/220] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:46 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:47.758412 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-efd1287e-4c7b-4567-be7f-475014d065ab tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:47.759023 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-efd1287e-4c7b-4567-be7f-475014d065ab tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:47.766446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd1287e-4c7b-4567-be7f-475014d065ab tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:47.766934 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd1287e-4c7b-4567-be7f-475014d065ab tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:47.767369 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd1287e-4c7b-4567-be7f-475014d065ab tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:47.768156 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd1287e-4c7b-4567-be7f-475014d065ab tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:47.768609 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd1287e-4c7b-4567-be7f-475014d065ab tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:47.769032 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd1287e-4c7b-4567-be7f-475014d065ab tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:47.929759 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-efd1287e-4c7b-4567-be7f-475014d065ab tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:47.938035 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-efd1287e-4c7b-4567-be7f-475014d065ab tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.183770 Oct 14 17:56:47.938825 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 117/221] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:47 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:48.963110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f4deba5c-6eb8-4a45-856b-671d8075b19a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:48.963949 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f4deba5c-6eb8-4a45-856b-671d8075b19a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:48.970740 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f4deba5c-6eb8-4a45-856b-671d8075b19a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:48.971213 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f4deba5c-6eb8-4a45-856b-671d8075b19a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:48.971638 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f4deba5c-6eb8-4a45-856b-671d8075b19a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:48.972348 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f4deba5c-6eb8-4a45-856b-671d8075b19a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:48.972789 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f4deba5c-6eb8-4a45-856b-671d8075b19a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:48.973196 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f4deba5c-6eb8-4a45-856b-671d8075b19a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:49.124025 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f4deba5c-6eb8-4a45-856b-671d8075b19a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:49.133397 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f4deba5c-6eb8-4a45-856b-671d8075b19a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.175086 Oct 14 17:56:49.134165 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 105/222] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:48 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:50.158735 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2a339156-e550-4472-bb75-2e650cf41440 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:50.159365 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2a339156-e550-4472-bb75-2e650cf41440 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:50.167378 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a339156-e550-4472-bb75-2e650cf41440 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:50.168265 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a339156-e550-4472-bb75-2e650cf41440 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:50.168864 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a339156-e550-4472-bb75-2e650cf41440 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:50.170125 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a339156-e550-4472-bb75-2e650cf41440 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:50.170881 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a339156-e550-4472-bb75-2e650cf41440 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:50.171465 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a339156-e550-4472-bb75-2e650cf41440 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:50.319794 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2a339156-e550-4472-bb75-2e650cf41440 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:50.329004 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2a339156-e550-4472-bb75-2e650cf41440 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.174448 Oct 14 17:56:50.329636 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 118/223] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:50 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:51.353663 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-97540c90-e472-494c-bf9f-ff516202521d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:51.354797 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-97540c90-e472-494c-bf9f-ff516202521d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:51.362484 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97540c90-e472-494c-bf9f-ff516202521d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:51.362958 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97540c90-e472-494c-bf9f-ff516202521d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:51.363412 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97540c90-e472-494c-bf9f-ff516202521d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:51.364445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97540c90-e472-494c-bf9f-ff516202521d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:51.364903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97540c90-e472-494c-bf9f-ff516202521d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:51.365378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97540c90-e472-494c-bf9f-ff516202521d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:51.565948 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-97540c90-e472-494c-bf9f-ff516202521d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:51.574728 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-97540c90-e472-494c-bf9f-ff516202521d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.225293 Oct 14 17:56:51.575503 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 106/224] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:51 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:52.600007 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d6d2e7e9-2a58-422a-8059-9b57d43eacec tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:52.600601 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d6d2e7e9-2a58-422a-8059-9b57d43eacec tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:52.607716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6d2e7e9-2a58-422a-8059-9b57d43eacec tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:52.607940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6d2e7e9-2a58-422a-8059-9b57d43eacec tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:52.608367 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6d2e7e9-2a58-422a-8059-9b57d43eacec tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:52.609150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6d2e7e9-2a58-422a-8059-9b57d43eacec tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:52.609593 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6d2e7e9-2a58-422a-8059-9b57d43eacec tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:52.610020 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6d2e7e9-2a58-422a-8059-9b57d43eacec tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:52.749308 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d6d2e7e9-2a58-422a-8059-9b57d43eacec tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:52.757063 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d6d2e7e9-2a58-422a-8059-9b57d43eacec tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.160932 Oct 14 17:56:52.757635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 119/225] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:52 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:53.096575 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a49ef9b2-24c5-430e-8655-c40f2961f0f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:53.097658 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a49ef9b2-24c5-430e-8655-c40f2961f0f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:53.104138 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a49ef9b2-24c5-430e-8655-c40f2961f0f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:53.104612 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a49ef9b2-24c5-430e-8655-c40f2961f0f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:53.105037 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a49ef9b2-24c5-430e-8655-c40f2961f0f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:53.105709 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a49ef9b2-24c5-430e-8655-c40f2961f0f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:53.106154 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a49ef9b2-24c5-430e-8655-c40f2961f0f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:53.107766 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a49ef9b2-24c5-430e-8655-c40f2961f0f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:53.131392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a49ef9b2-24c5-430e-8655-c40f2961f0f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/ips" status: 200 len: 146 microversion: 2.1 time: 0.039452 Oct 14 17:56:53.131969 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 107/226] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Oct 14 17:56:53 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:53.587203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1241624219", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "networks": [{"uuid": "0839c4a7-60df-4004-b766-c9b4558a0a2e"}]}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:53.640535 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] validate_networks() for [('0839c4a7-60df-4004-b766-c9b4558a0a2e', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:56:53.780977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5d3289ee-c682-4d3e-a853-4deb77ff1ff5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:53.781580 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-5d3289ee-c682-4d3e-a853-4deb77ff1ff5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:53.787866 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5d3289ee-c682-4d3e-a853-4deb77ff1ff5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:53.788377 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5d3289ee-c682-4d3e-a853-4deb77ff1ff5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:53.788815 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5d3289ee-c682-4d3e-a853-4deb77ff1ff5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:53.789503 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5d3289ee-c682-4d3e-a853-4deb77ff1ff5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:53.789956 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5d3289ee-c682-4d3e-a853-4deb77ff1ff5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:53.790375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5d3289ee-c682-4d3e-a853-4deb77ff1ff5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:54.028840 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5d3289ee-c682-4d3e-a853-4deb77ff1ff5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:54.038065 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-5d3289ee-c682-4d3e-a853-4deb77ff1ff5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.261674 Oct 14 17:56:54.052041 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 108/227] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:53 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:54.071422 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:56:54.071844 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:56:54.072352 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:56:54.072787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:56:54.073194 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:56:54.082440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:54.082913 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:54.083341 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:54.084096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:54.084548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:54.084970 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:54.101697 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Getting quotas for project 19f786f7363e44d78e478f2fec202f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:56:54.105620 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Getting quotas for user 1a23bceab9e14ee8907eef2a2df85799 and project 19f786f7363e44d78e478f2fec202f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:56:54.117256 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:56:54.120151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:56:54.169418 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ed973631-641a-4465-9516-96c672dedb74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585963 Oct 14 17:56:54.169987 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 120/228] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 17:56:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 17:56:54.181136 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3f7fa54e-f4aa-496d-9aaf-7c8591ed6f28 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:54.181880 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3f7fa54e-f4aa-496d-9aaf-7c8591ed6f28 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:54.242419 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3f7fa54e-f4aa-496d-9aaf-7c8591ed6f28 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:54.249331 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3f7fa54e-f4aa-496d-9aaf-7c8591ed6f28 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1219 microversion: 2.1 time: 0.072079 Oct 14 17:56:54.250006 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 109/229] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:54 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:55.062907 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-efcdded3-5b9e-491f-aad8-0e4328681cbc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:55.063655 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-efcdded3-5b9e-491f-aad8-0e4328681cbc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:55.075141 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efcdded3-5b9e-491f-aad8-0e4328681cbc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:55.075697 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efcdded3-5b9e-491f-aad8-0e4328681cbc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:55.076164 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efcdded3-5b9e-491f-aad8-0e4328681cbc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:55.076857 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efcdded3-5b9e-491f-aad8-0e4328681cbc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:55.077307 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efcdded3-5b9e-491f-aad8-0e4328681cbc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:55.077721 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efcdded3-5b9e-491f-aad8-0e4328681cbc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:55.206559 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-efcdded3-5b9e-491f-aad8-0e4328681cbc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:55.215549 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-efcdded3-5b9e-491f-aad8-0e4328681cbc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.158204 Oct 14 17:56:55.216662 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 121/230] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:55 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:55.272507 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-34d94250-f7dc-4315-a46f-f3cea1ee802d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:55.273108 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-34d94250-f7dc-4315-a46f-f3cea1ee802d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:55.280752 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34d94250-f7dc-4315-a46f-f3cea1ee802d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:55.281229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34d94250-f7dc-4315-a46f-f3cea1ee802d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:55.281662 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34d94250-f7dc-4315-a46f-f3cea1ee802d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:55.282347 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34d94250-f7dc-4315-a46f-f3cea1ee802d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:55.282799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34d94250-f7dc-4315-a46f-f3cea1ee802d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:55.283225 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-34d94250-f7dc-4315-a46f-f3cea1ee802d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:55.351023 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-34d94250-f7dc-4315-a46f-f3cea1ee802d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:55.360536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-34d94250-f7dc-4315-a46f-f3cea1ee802d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1271 microversion: 2.1 time: 0.091790 Oct 14 17:56:55.361356 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 110/231] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:55 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:56.240151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7669b6cc-5742-46b3-875c-bf5f432de514 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:56.240735 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7669b6cc-5742-46b3-875c-bf5f432de514 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:56.248540 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7669b6cc-5742-46b3-875c-bf5f432de514 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:56.249014 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7669b6cc-5742-46b3-875c-bf5f432de514 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:56.249436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7669b6cc-5742-46b3-875c-bf5f432de514 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:56.250117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7669b6cc-5742-46b3-875c-bf5f432de514 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:56.250575 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7669b6cc-5742-46b3-875c-bf5f432de514 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:56.250968 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7669b6cc-5742-46b3-875c-bf5f432de514 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:56.385275 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7cbff0ee-dfba-441e-afce-478acca7d4a1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:56.386736 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7cbff0ee-dfba-441e-afce-478acca7d4a1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:56.395811 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7cbff0ee-dfba-441e-afce-478acca7d4a1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:56.396723 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7cbff0ee-dfba-441e-afce-478acca7d4a1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:56.397230 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7cbff0ee-dfba-441e-afce-478acca7d4a1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:56.398036 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7cbff0ee-dfba-441e-afce-478acca7d4a1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:56.398497 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7cbff0ee-dfba-441e-afce-478acca7d4a1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:56.398962 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7cbff0ee-dfba-441e-afce-478acca7d4a1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:56.490558 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7669b6cc-5742-46b3-875c-bf5f432de514 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:56.499185 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7669b6cc-5742-46b3-875c-bf5f432de514 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.262937 Oct 14 17:56:56.499998 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 122/232] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:56 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:56.584468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-df736a13-4491-4f78-9f52-53b44d092235 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:56.584875 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-df736a13-4491-4f78-9f52-53b44d092235 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:56.591291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df736a13-4491-4f78-9f52-53b44d092235 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:56.592402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df736a13-4491-4f78-9f52-53b44d092235 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:56.592847 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df736a13-4491-4f78-9f52-53b44d092235 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:56.594648 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df736a13-4491-4f78-9f52-53b44d092235 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:56.595166 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df736a13-4491-4f78-9f52-53b44d092235 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:56.595618 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df736a13-4491-4f78-9f52-53b44d092235 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:56.623119 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-df736a13-4491-4f78-9f52-53b44d092235 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/ips" status: 200 len: 152 microversion: 2.20 time: 0.043117 Oct 14 17:56:56.623719 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 123/233] 10.222.0.27 () {60 vars in 1289 bytes} [Fri Oct 14 17:56:56 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:56:56.631803 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7cbff0ee-dfba-441e-afce-478acca7d4a1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:56.642248 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7cbff0ee-dfba-441e-afce-478acca7d4a1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1319 microversion: 2.1 time: 0.261946 Oct 14 17:56:56.643032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 111/234] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:56 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:56.970893 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-1cf2fa4e-8ecb-49d8-b15a-e992fc0fe1f1 req-909ba3b3-53cb-4a5e-a2d4-1963236b1423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540e714d-90e7-4e09-b976-07d53f7a8444", "tag": "a586fa77-4dad-4db8-be6a-9bbf0c9aa156"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:56.983437 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-1cf2fa4e-8ecb-49d8-b15a-e992fc0fe1f1 req-909ba3b3-53cb-4a5e-a2d4-1963236b1423 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:56.984392 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-1cf2fa4e-8ecb-49d8-b15a-e992fc0fe1f1 req-909ba3b3-53cb-4a5e-a2d4-1963236b1423 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:56.984975 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-1cf2fa4e-8ecb-49d8-b15a-e992fc0fe1f1 req-909ba3b3-53cb-4a5e-a2d4-1963236b1423 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:57.000393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-1cf2fa4e-8ecb-49d8-b15a-e992fc0fe1f1 req-909ba3b3-53cb-4a5e-a2d4-1963236b1423 service nova] Creating event network-changed:a586fa77-4dad-4db8-be6a-9bbf0c9aa156 for instance 540e714d-90e7-4e09-b976-07d53f7a8444 on hv-cinder-74915 Oct 14 17:56:57.006093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-1cf2fa4e-8ecb-49d8-b15a-e992fc0fe1f1 req-909ba3b3-53cb-4a5e-a2d4-1963236b1423 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042014 Oct 14 17:56:57.007334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 124/235] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:57.125296 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-52c4025b-9108-46bc-9639-7594474642ea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d72095a2-8608-4600-80e4-24e9a8311ea8"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:57.127676 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-52c4025b-9108-46bc-9639-7594474642ea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:57.133880 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c4025b-9108-46bc-9639-7594474642ea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:57.134362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c4025b-9108-46bc-9639-7594474642ea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:57.134788 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c4025b-9108-46bc-9639-7594474642ea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:57.135475 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c4025b-9108-46bc-9639-7594474642ea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:57.135939 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c4025b-9108-46bc-9639-7594474642ea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:57.136355 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c4025b-9108-46bc-9639-7594474642ea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:57.409293 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-52c4025b-9108-46bc-9639-7594474642ea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290194 Oct 14 17:56:57.410214 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 112/236] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 17:56:57 2022] POST /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:56:57.522261 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2ae045bc-192c-4a8a-b204-11a9695d2f78 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:57.522953 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2ae045bc-192c-4a8a-b204-11a9695d2f78 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:57.530070 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ae045bc-192c-4a8a-b204-11a9695d2f78 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:57.530703 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ae045bc-192c-4a8a-b204-11a9695d2f78 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:57.531147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ae045bc-192c-4a8a-b204-11a9695d2f78 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:57.531835 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ae045bc-192c-4a8a-b204-11a9695d2f78 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:57.532311 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ae045bc-192c-4a8a-b204-11a9695d2f78 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:57.532733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ae045bc-192c-4a8a-b204-11a9695d2f78 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:57.662694 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2ae045bc-192c-4a8a-b204-11a9695d2f78 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:57.670602 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-15103fdf-0eec-4c9c-822f-1c638e31920f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:57.671099 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2ae045bc-192c-4a8a-b204-11a9695d2f78 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.152972 Oct 14 17:56:57.671295 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-15103fdf-0eec-4c9c-822f-1c638e31920f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:57.671659 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 125/237] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:57 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:56:57.677572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15103fdf-0eec-4c9c-822f-1c638e31920f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:57.678054 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15103fdf-0eec-4c9c-822f-1c638e31920f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:57.678485 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15103fdf-0eec-4c9c-822f-1c638e31920f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:57.679170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15103fdf-0eec-4c9c-822f-1c638e31920f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:57.679618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15103fdf-0eec-4c9c-822f-1c638e31920f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:57.680064 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15103fdf-0eec-4c9c-822f-1c638e31920f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:57.812002 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-15103fdf-0eec-4c9c-822f-1c638e31920f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:57.815475 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:57.820511 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-15103fdf-0eec-4c9c-822f-1c638e31920f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1319 microversion: 2.1 time: 0.155338 Oct 14 17:56:57.821254 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 113/238] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:57 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:58.694921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-698cc4a5-bd2c-456f-b44e-2608672a771e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:58.696575 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-698cc4a5-bd2c-456f-b44e-2608672a771e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:58.704178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-698cc4a5-bd2c-456f-b44e-2608672a771e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:58.704794 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-698cc4a5-bd2c-456f-b44e-2608672a771e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:58.705471 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-698cc4a5-bd2c-456f-b44e-2608672a771e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:58.706397 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-698cc4a5-bd2c-456f-b44e-2608672a771e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:58.707027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-698cc4a5-bd2c-456f-b44e-2608672a771e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:58.707658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-698cc4a5-bd2c-456f-b44e-2608672a771e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:58.844969 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-628bd0ee-9134-489d-b957-9b048050e786 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:58.846387 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-628bd0ee-9134-489d-b957-9b048050e786 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:58.854242 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-628bd0ee-9134-489d-b957-9b048050e786 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:58.854641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-628bd0ee-9134-489d-b957-9b048050e786 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:58.855060 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-628bd0ee-9134-489d-b957-9b048050e786 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:58.855763 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-628bd0ee-9134-489d-b957-9b048050e786 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:58.856274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-628bd0ee-9134-489d-b957-9b048050e786 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:58.856878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-628bd0ee-9134-489d-b957-9b048050e786 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:58.985995 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-698cc4a5-bd2c-456f-b44e-2608672a771e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:58.993618 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-698cc4a5-bd2c-456f-b44e-2608672a771e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.303084 Oct 14 17:56:58.994272 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 126/239] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:58 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:59.089860 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-628bd0ee-9134-489d-b957-9b048050e786 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:56:59.098381 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-628bd0ee-9134-489d-b957-9b048050e786 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1319 microversion: 2.1 time: 0.257944 Oct 14 17:56:59.099007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 114/240] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:56:58 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:56:59.707813 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8545627a-e567-4199-b243-97dcc568b8fb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:56:59.708399 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8545627a-e567-4199-b243-97dcc568b8fb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:59.714204 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8545627a-e567-4199-b243-97dcc568b8fb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:59.714687 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8545627a-e567-4199-b243-97dcc568b8fb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:59.715113 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8545627a-e567-4199-b243-97dcc568b8fb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:59.715785 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8545627a-e567-4199-b243-97dcc568b8fb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:59.716748 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8545627a-e567-4199-b243-97dcc568b8fb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:59.717257 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8545627a-e567-4199-b243-97dcc568b8fb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:59.739898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-8545627a-e567-4199-b243-97dcc568b8fb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lazy-loading 'flavor' on Instance uuid 58c0a43e-1109-4ff9-9617-8a2958de7b0b {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:56:59.765385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:59.929188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8545627a-e567-4199-b243-97dcc568b8fb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "POST /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/action" status: 202 len: 0 microversion: 2.20 time: 0.225051 Oct 14 17:56:59.929780 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 127/241] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Oct 14 17:56:59 2022] POST /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 17:56:59.938026 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:56:59.938630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:56:59.945079 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:59.945568 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:59.946004 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:56:59.946746 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:56:59.947200 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:56:59.947624 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:00.019674 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-97de8d87-381b-4f17-954a-9a7fa6ca12ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:00.020479 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-97de8d87-381b-4f17-954a-9a7fa6ca12ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:00.027113 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97de8d87-381b-4f17-954a-9a7fa6ca12ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:00.027637 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97de8d87-381b-4f17-954a-9a7fa6ca12ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:00.028338 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97de8d87-381b-4f17-954a-9a7fa6ca12ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:00.030122 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97de8d87-381b-4f17-954a-9a7fa6ca12ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:00.030610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97de8d87-381b-4f17-954a-9a7fa6ca12ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:00.031032 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97de8d87-381b-4f17-954a-9a7fa6ca12ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:00.154872 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:00.164730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:00.169217 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:00.170750 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-07693562-33bb-4956-b538-e5f3c6b290e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.236539 Oct 14 17:57:00.181022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 115/242] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:56:59 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:00.181022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b694017d-6a1f-4c44-9278-56865163f3e1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:00.181022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b694017d-6a1f-4c44-9278-56865163f3e1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:00.186398 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b694017d-6a1f-4c44-9278-56865163f3e1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:00.187054 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b694017d-6a1f-4c44-9278-56865163f3e1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:00.187634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b694017d-6a1f-4c44-9278-56865163f3e1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:00.189067 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b694017d-6a1f-4c44-9278-56865163f3e1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:00.190334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b694017d-6a1f-4c44-9278-56865163f3e1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:00.190930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b694017d-6a1f-4c44-9278-56865163f3e1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:00.229180 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-97de8d87-381b-4f17-954a-9a7fa6ca12ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:00.237815 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-97de8d87-381b-4f17-954a-9a7fa6ca12ef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.222631 Oct 14 17:57:00.238389 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 128/243] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:00 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:00.345846 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b694017d-6a1f-4c44-9278-56865163f3e1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:00.353893 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b694017d-6a1f-4c44-9278-56865163f3e1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1319 microversion: 2.1 time: 0.180739 Oct 14 17:57:00.354471 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 116/244] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:00 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:00.855804 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-395a5e30-f51a-4c58-a7a7-dc55218655f0 req-78ecf74c-d035-4eef-83ad-10f9d48d2019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540e714d-90e7-4e09-b976-07d53f7a8444", "name": "network-vif-plugged", "status": "completed", "tag": "a586fa77-4dad-4db8-be6a-9bbf0c9aa156"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:00.866411 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-395a5e30-f51a-4c58-a7a7-dc55218655f0 req-78ecf74c-d035-4eef-83ad-10f9d48d2019 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:00.866941 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-395a5e30-f51a-4c58-a7a7-dc55218655f0 req-78ecf74c-d035-4eef-83ad-10f9d48d2019 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:00.867364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-395a5e30-f51a-4c58-a7a7-dc55218655f0 req-78ecf74c-d035-4eef-83ad-10f9d48d2019 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:00.880945 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-395a5e30-f51a-4c58-a7a7-dc55218655f0 req-78ecf74c-d035-4eef-83ad-10f9d48d2019 service nova] Creating event network-vif-plugged:a586fa77-4dad-4db8-be6a-9bbf0c9aa156 for instance 540e714d-90e7-4e09-b976-07d53f7a8444 on hv-cinder-74915 Oct 14 17:57:00.885920 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-395a5e30-f51a-4c58-a7a7-dc55218655f0 req-78ecf74c-d035-4eef-83ad-10f9d48d2019 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034021 Oct 14 17:57:00.886726 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 129/245] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:57:01.202335 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:01.202942 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:01.209319 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:01.209798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:01.210231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:01.210914 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:01.211362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:01.211782 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:01.263173 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-fc438a87-ca54-4d32-8801-64f239dc3952 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:01.263900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-fc438a87-ca54-4d32-8801-64f239dc3952 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:01.269941 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc438a87-ca54-4d32-8801-64f239dc3952 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:01.270419 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc438a87-ca54-4d32-8801-64f239dc3952 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:01.270848 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc438a87-ca54-4d32-8801-64f239dc3952 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:01.271532 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc438a87-ca54-4d32-8801-64f239dc3952 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:01.272013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc438a87-ca54-4d32-8801-64f239dc3952 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:01.272427 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fc438a87-ca54-4d32-8801-64f239dc3952 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:01.383617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:01.393184 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:01.394616 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:01.395762 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e18504ed-a4b3-4701-b699-c3a294648169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.198418 Oct 14 17:57:01.396389 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 117/246] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:01 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:01.400813 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9f4f9e8d-e5fb-430f-b210-e5a05923f9a6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:01.401460 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9f4f9e8d-e5fb-430f-b210-e5a05923f9a6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:01.408498 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f4f9e8d-e5fb-430f-b210-e5a05923f9a6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:01.408979 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f4f9e8d-e5fb-430f-b210-e5a05923f9a6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:01.409407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f4f9e8d-e5fb-430f-b210-e5a05923f9a6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:01.410095 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f4f9e8d-e5fb-430f-b210-e5a05923f9a6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:01.410788 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f4f9e8d-e5fb-430f-b210-e5a05923f9a6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:01.411592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f4f9e8d-e5fb-430f-b210-e5a05923f9a6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:01.437024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-fc438a87-ca54-4d32-8801-64f239dc3952 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:01.444613 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-fc438a87-ca54-4d32-8801-64f239dc3952 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.185772 Oct 14 17:57:01.445180 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 130/247] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:01 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:01.559111 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-9f4f9e8d-e5fb-430f-b210-e5a05923f9a6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:01.567461 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9f4f9e8d-e5fb-430f-b210-e5a05923f9a6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1319 microversion: 2.1 time: 0.170139 Oct 14 17:57:01.568044 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 118/248] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:01 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:02.421810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:02.422402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:02.424338 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:02.429922 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:02.430564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:02.430994 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:02.431901 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:02.432592 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:02.433222 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:02.470734 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-55870118-7407-4e5e-adc1-f7f9f63a7147 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:02.471564 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-55870118-7407-4e5e-adc1-f7f9f63a7147 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:02.478525 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55870118-7407-4e5e-adc1-f7f9f63a7147 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:02.479334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55870118-7407-4e5e-adc1-f7f9f63a7147 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:02.479768 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55870118-7407-4e5e-adc1-f7f9f63a7147 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:02.480497 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55870118-7407-4e5e-adc1-f7f9f63a7147 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:02.480939 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55870118-7407-4e5e-adc1-f7f9f63a7147 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:02.481603 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55870118-7407-4e5e-adc1-f7f9f63a7147 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:02.622361 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:02.630294 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:02.631741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:02.632959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5fa9f42f-075b-4989-a5bd-cbbc2f02e4f9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.215437 Oct 14 17:57:02.633518 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 131/249] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:02 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:02.638446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-08925ee8-087b-4000-be93-25f5faaf8df6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:02.639319 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-08925ee8-087b-4000-be93-25f5faaf8df6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:02.644844 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08925ee8-087b-4000-be93-25f5faaf8df6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:02.645334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08925ee8-087b-4000-be93-25f5faaf8df6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:02.645768 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08925ee8-087b-4000-be93-25f5faaf8df6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:02.648801 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-55870118-7407-4e5e-adc1-f7f9f63a7147 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:02.652551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08925ee8-087b-4000-be93-25f5faaf8df6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:02.653017 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08925ee8-087b-4000-be93-25f5faaf8df6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:02.653553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08925ee8-087b-4000-be93-25f5faaf8df6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:02.657143 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-55870118-7407-4e5e-adc1-f7f9f63a7147 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.191711 Oct 14 17:57:02.657706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 119/250] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:02 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:02.787372 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-08925ee8-087b-4000-be93-25f5faaf8df6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:02.795669 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-08925ee8-087b-4000-be93-25f5faaf8df6 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1508 microversion: 2.1 time: 0.161218 Oct 14 17:57:02.796268 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 132/251] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:02 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:03.659799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:03.660339 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:03.666971 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:03.667463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:03.667924 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:03.668594 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:03.669045 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:03.670643 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:03.680975 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0641ab84-f204-4543-a810-af4e852037d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:03.681897 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0641ab84-f204-4543-a810-af4e852037d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:03.688288 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0641ab84-f204-4543-a810-af4e852037d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:03.688777 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0641ab84-f204-4543-a810-af4e852037d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:03.689212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0641ab84-f204-4543-a810-af4e852037d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:03.689916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0641ab84-f204-4543-a810-af4e852037d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:03.690366 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0641ab84-f204-4543-a810-af4e852037d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:03.690787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0641ab84-f204-4543-a810-af4e852037d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:03.871471 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:03.876163 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0641ab84-f204-4543-a810-af4e852037d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:03.879901 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:03.881341 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:03.882489 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b81bd5a0-b345-4bb9-913f-e43b0a04ef1d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.226724 Oct 14 17:57:03.883043 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 120/252] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:03 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:03.883633 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0641ab84-f204-4543-a810-af4e852037d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.207369 Oct 14 17:57:03.884214 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 133/253] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:03 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:04.904016 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:04.905902 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:04.906733 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-6a6b159b-1d04-48ba-bd86-6374d3c13f3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:04.908005 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-6a6b159b-1d04-48ba-bd86-6374d3c13f3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:04.909640 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:04.910030 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:04.910305 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:04.916278 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a6b159b-1d04-48ba-bd86-6374d3c13f3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:04.917096 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a6b159b-1d04-48ba-bd86-6374d3c13f3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:04.917675 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:04.918059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a6b159b-1d04-48ba-bd86-6374d3c13f3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:04.918202 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:04.918615 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:04.918775 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a6b159b-1d04-48ba-bd86-6374d3c13f3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:04.919351 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:04.919465 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a6b159b-1d04-48ba-bd86-6374d3c13f3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:04.919802 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:04.920007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a6b159b-1d04-48ba-bd86-6374d3c13f3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:04.921532 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:05.144913 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:05.149954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6a6b159b-1d04-48ba-bd86-6374d3c13f3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:05.153246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:05.154811 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:05.156038 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-df294322-886a-4a39-99d3-dd6b7215096a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.252712 Oct 14 17:57:05.156551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 134/254] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:04 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:57:05.158989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-6a6b159b-1d04-48ba-bd86-6374d3c13f3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.256181 Oct 14 17:57:05.159554 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 121/255] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:04 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:06.187361 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-06c8daca-e326-40a5-b344-ea9a0fd0f33c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:06.187985 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-06c8daca-e326-40a5-b344-ea9a0fd0f33c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:06.189887 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:06.190634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:06.200080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:06.201410 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=60 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:06.202857 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06c8daca-e326-40a5-b344-ea9a0fd0f33c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:06.203347 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06c8daca-e326-40a5-b344-ea9a0fd0f33c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:06.203824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06c8daca-e326-40a5-b344-ea9a0fd0f33c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:06.204541 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:06.205123 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:06.206002 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:06.206612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:06.207188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:06.208118 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06c8daca-e326-40a5-b344-ea9a0fd0f33c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:06.209477 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06c8daca-e326-40a5-b344-ea9a0fd0f33c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:06.211155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06c8daca-e326-40a5-b344-ea9a0fd0f33c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:06.598167 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:06.609553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:06.609723 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-06c8daca-e326-40a5-b344-ea9a0fd0f33c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:06.613546 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:06.615197 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-734ff3c5-3dd5-406e-a891-717751500864 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.435421 Oct 14 17:57:06.616761 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 135/256] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:06 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:06.627089 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-06c8daca-e326-40a5-b344-ea9a0fd0f33c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.448287 Oct 14 17:57:06.627691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 122/257] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:06 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:07.136275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7066be4a-d623-4719-9335-cec30cd7633a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:07.145497 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7066be4a-d623-4719-9335-cec30cd7633a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:07.146077 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7066be4a-d623-4719-9335-cec30cd7633a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:07.146610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7066be4a-d623-4719-9335-cec30cd7633a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:07.213678 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7066be4a-d623-4719-9335-cec30cd7633a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Going to try to stop instance {{(pid=118655) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 14 17:57:07.274805 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7066be4a-d623-4719-9335-cec30cd7633a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/action" status: 202 len: 0 microversion: 2.1 time: 0.145339 Oct 14 17:57:07.276998 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 136/258] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:57:07 2022] POST /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:57:07.285395 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-04baad83-882c-4989-bf4e-09eb7d92ef35 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:07.287616 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-04baad83-882c-4989-bf4e-09eb7d92ef35 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:07.298123 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04baad83-882c-4989-bf4e-09eb7d92ef35 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:07.298863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04baad83-882c-4989-bf4e-09eb7d92ef35 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:07.300108 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04baad83-882c-4989-bf4e-09eb7d92ef35 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:07.301681 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04baad83-882c-4989-bf4e-09eb7d92ef35 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:07.302359 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04baad83-882c-4989-bf4e-09eb7d92ef35 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:07.303036 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04baad83-882c-4989-bf4e-09eb7d92ef35 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:07.503510 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-04baad83-882c-4989-bf4e-09eb7d92ef35 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:07.513366 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-04baad83-882c-4989-bf4e-09eb7d92ef35 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.233248 Oct 14 17:57:07.527971 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 123/259] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:07 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:07.642840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:07.643664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:07.651029 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:07.657330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3d9a615f-2181-4f28-b236-071542dc1153 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:07.658412 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3d9a615f-2181-4f28-b236-071542dc1153 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:07.662660 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:07.663186 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:07.664030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:07.664924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:07.666078 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:07.673156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d9a615f-2181-4f28-b236-071542dc1153 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:07.675907 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d9a615f-2181-4f28-b236-071542dc1153 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:07.676818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d9a615f-2181-4f28-b236-071542dc1153 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:07.677865 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d9a615f-2181-4f28-b236-071542dc1153 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:07.678554 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d9a615f-2181-4f28-b236-071542dc1153 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:07.679978 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d9a615f-2181-4f28-b236-071542dc1153 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:07.927628 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3d9a615f-2181-4f28-b236-071542dc1153 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:07.930734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:07.940647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:07.942220 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:07.942350 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3d9a615f-2181-4f28-b236-071542dc1153 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.289719 Oct 14 17:57:07.942934 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 124/260] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:07 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:07.943756 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7b775792-3c8b-4d07-870b-18d5f4c5d444 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.306464 Oct 14 17:57:07.944838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 137/261] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:07 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:08.539509 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8f8a9702-eca2-4cb5-8be7-67f64e2be1e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:08.540008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8f8a9702-eca2-4cb5-8be7-67f64e2be1e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:08.547389 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8f8a9702-eca2-4cb5-8be7-67f64e2be1e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:08.547931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8f8a9702-eca2-4cb5-8be7-67f64e2be1e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:08.548364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8f8a9702-eca2-4cb5-8be7-67f64e2be1e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:08.549272 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8f8a9702-eca2-4cb5-8be7-67f64e2be1e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:08.550711 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8f8a9702-eca2-4cb5-8be7-67f64e2be1e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:08.551139 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8f8a9702-eca2-4cb5-8be7-67f64e2be1e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:08.875788 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8f8a9702-eca2-4cb5-8be7-67f64e2be1e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:08.883936 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8f8a9702-eca2-4cb5-8be7-67f64e2be1e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.349245 Oct 14 17:57:08.885078 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 125/262] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:08 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:08.984156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:08.985719 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-eedbfcfa-fcb4-4b28-a4bd-ef0150b969f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:08.986320 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-eedbfcfa-fcb4-4b28-a4bd-ef0150b969f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:08.986686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:08.997575 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:08.999739 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eedbfcfa-fcb4-4b28-a4bd-ef0150b969f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.000380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eedbfcfa-fcb4-4b28-a4bd-ef0150b969f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.000894 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eedbfcfa-fcb4-4b28-a4bd-ef0150b969f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.001218 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.001840 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.003255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.003386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eedbfcfa-fcb4-4b28-a4bd-ef0150b969f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.003464 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.003550 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eedbfcfa-fcb4-4b28-a4bd-ef0150b969f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.003630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.003710 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eedbfcfa-fcb4-4b28-a4bd-ef0150b969f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.318641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:09.327946 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:09.330721 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:09.332149 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e6464de1-3f9c-494b-adf8-4cb3cef343ab tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.365533 Oct 14 17:57:09.333639 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 126/263] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:08 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:09.334576 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-eedbfcfa-fcb4-4b28-a4bd-ef0150b969f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:09.343867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-eedbfcfa-fcb4-4b28-a4bd-ef0150b969f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1501 microversion: 2.1 time: 0.379425 Oct 14 17:57:09.362260 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 138/264] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:08 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1501 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:09.370408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc61d085-6eea-4225-aa1a-647b2351b473"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:09.375783 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:09.381949 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.382439 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.382869 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.383691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.384172 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.384590 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.412720 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] HTTP exception thrown: Cannot 'attach_volume' instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a while it is in vm_state rescued Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Request method failure captured: Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: POST /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a/os-volume_attachments HTTP/1.1 Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 74 Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaKDmRrof5YHVAQuXH5mCmDyChagswaliw2J6djtI1m1MzfFbX_OeNHyKd6c1qH-kQE6f6YepZsCS80ByX10HmAJEJ4z6UGwvEVyJkW_2zz4EnwAkiavkywX7UaHyl4vi6r80kNDj3tqM4-o-KGZziEuY7SpETnctapai-BZfnW-4co Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 530fdfc3448a40b7aa85170873d3f0ff Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 17:57:09.414732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_530fdfc3448a40b7aa85170873d3f0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 530fdfc3448a40b7aa85170873d3f0ff Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-ServerRescueNegativeTestJSON-155189197-project Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: c091bf027839447da4c713deb291ed1f Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-ServerRescueNegativeTestJSON-155189197-project Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {"volumeAttachment": {"volumeId": "cc61d085-6eea-4225-aa1a-647b2351b473"}} Oct 14 17:57:09.416059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Cannot 'attach_volume' instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a while it is in vm_state rescued Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'server_id': '36f20c98-c68a-4dbb-8f8b-0506c63f5d6a', 'body': {'volumeAttachment': {'volumeId': 'cc61d085-6eea-4225-aa1a-647b2351b473'}}} Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:57:09.416931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a while it is in vm_state rescued Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:57:09.418180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:57:09.421145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:57:09.421145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:57:09.421145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a while it is in vm_state rescued Oct 14 17:57:09.421145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:57:09.421145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Returning 409 to user: Cannot 'attach_volume' instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a while it is in vm_state rescued {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:57:09.421145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9fc5a347-6e61-442f-bdac-3b5432166e8d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049825 Oct 14 17:57:09.421145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 127/265] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 17:57:09 2022] POST /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 14 17:57:09.426034 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f8dc1ebb-26e0-457c-9a14-0623814ffb4e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:09.426769 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f8dc1ebb-26e0-457c-9a14-0623814ffb4e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:09.432877 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f8dc1ebb-26e0-457c-9a14-0623814ffb4e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.433377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f8dc1ebb-26e0-457c-9a14-0623814ffb4e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.433792 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f8dc1ebb-26e0-457c-9a14-0623814ffb4e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.434646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f8dc1ebb-26e0-457c-9a14-0623814ffb4e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.435286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f8dc1ebb-26e0-457c-9a14-0623814ffb4e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.435944 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f8dc1ebb-26e0-457c-9a14-0623814ffb4e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.664777 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f8dc1ebb-26e0-457c-9a14-0623814ffb4e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a/action" status: 202 len: 0 microversion: 2.1 time: 0.241644 Oct 14 17:57:09.666189 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 139/266] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:57:09 2022] POST /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:57:09.674794 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-80ae0a3d-d341-41d9-88b3-681a97f9356e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:09.682231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-80ae0a3d-d341-41d9-88b3-681a97f9356e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:09.709300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80ae0a3d-d341-41d9-88b3-681a97f9356e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.709987 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80ae0a3d-d341-41d9-88b3-681a97f9356e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.710785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80ae0a3d-d341-41d9-88b3-681a97f9356e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.711487 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80ae0a3d-d341-41d9-88b3-681a97f9356e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.711986 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80ae0a3d-d341-41d9-88b3-681a97f9356e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.712390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80ae0a3d-d341-41d9-88b3-681a97f9356e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.908057 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-80fe5331-1ada-4da1-b1e7-5ca710489b84 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:09.908748 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-80fe5331-1ada-4da1-b1e7-5ca710489b84 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:09.921453 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-80fe5331-1ada-4da1-b1e7-5ca710489b84 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.922520 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-80fe5331-1ada-4da1-b1e7-5ca710489b84 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.923151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-80fe5331-1ada-4da1-b1e7-5ca710489b84 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:09.924079 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-80fe5331-1ada-4da1-b1e7-5ca710489b84 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:09.924707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-80fe5331-1ada-4da1-b1e7-5ca710489b84 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:09.925477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-80fe5331-1ada-4da1-b1e7-5ca710489b84 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:10.163336 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-80ae0a3d-d341-41d9-88b3-681a97f9356e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:10.184762 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-80ae0a3d-d341-41d9-88b3-681a97f9356e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1509 microversion: 2.1 time: 0.514005 Oct 14 17:57:10.185535 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 128/267] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:09 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1509 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:10.290522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-80fe5331-1ada-4da1-b1e7-5ca710489b84 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:10.303310 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-80fe5331-1ada-4da1-b1e7-5ca710489b84 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.399340 Oct 14 17:57:10.304615 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 140/268] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:09 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:10.362496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:10.363195 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:10.370249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:10.370931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:10.371508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:10.372406 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:10.372857 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:10.373496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:10.960233 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:10.976838 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:10.978540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:10.979758 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f27cd929-f0c7-4afa-a961-71c33a8f2c0d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.621157 Oct 14 17:57:10.980706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 129/269] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:10 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:11.210081 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dcc7e44e-3077-4934-9dc1-ac04b5e00695 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:11.211059 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-dcc7e44e-3077-4934-9dc1-ac04b5e00695 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:11.220206 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dcc7e44e-3077-4934-9dc1-ac04b5e00695 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:11.220928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dcc7e44e-3077-4934-9dc1-ac04b5e00695 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:11.225158 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dcc7e44e-3077-4934-9dc1-ac04b5e00695 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:11.230303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dcc7e44e-3077-4934-9dc1-ac04b5e00695 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:11.231479 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dcc7e44e-3077-4934-9dc1-ac04b5e00695 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:11.232118 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dcc7e44e-3077-4934-9dc1-ac04b5e00695 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:11.329024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5fb8f399-2b60-4a72-91c2-c970fe4d1481 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:11.330706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-5fb8f399-2b60-4a72-91c2-c970fe4d1481 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:11.337551 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5fb8f399-2b60-4a72-91c2-c970fe4d1481 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:11.338390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5fb8f399-2b60-4a72-91c2-c970fe4d1481 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:11.338974 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5fb8f399-2b60-4a72-91c2-c970fe4d1481 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:11.339849 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5fb8f399-2b60-4a72-91c2-c970fe4d1481 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:11.340667 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5fb8f399-2b60-4a72-91c2-c970fe4d1481 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:11.341275 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5fb8f399-2b60-4a72-91c2-c970fe4d1481 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:11.508124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-dcc7e44e-3077-4934-9dc1-ac04b5e00695 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:11.511663 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:11.516759 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-dcc7e44e-3077-4934-9dc1-ac04b5e00695 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1509 microversion: 2.1 time: 0.311829 Oct 14 17:57:11.517336 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 141/270] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:11 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:11.602981 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5fb8f399-2b60-4a72-91c2-c970fe4d1481 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:11.606321 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=100 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:11.612585 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-5fb8f399-2b60-4a72-91c2-c970fe4d1481 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.289832 Oct 14 17:57:11.613155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 130/271] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:11 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:12.005839 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:12.006540 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:12.014010 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:12.014976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:12.015467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:12.016417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:12.017056 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:12.017677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:12.209674 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:12.220090 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:12.222081 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:12.223623 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-91d5b51f-4cd6-43a0-983b-6f9523e4d5eb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.221592 Oct 14 17:57:12.240476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 142/272] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:12 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:12.544261 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8cca39e8-837a-4eee-a852-e5f7f02f1ffd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:12.546409 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8cca39e8-837a-4eee-a852-e5f7f02f1ffd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:12.558397 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cca39e8-837a-4eee-a852-e5f7f02f1ffd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:12.559801 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cca39e8-837a-4eee-a852-e5f7f02f1ffd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:12.561469 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cca39e8-837a-4eee-a852-e5f7f02f1ffd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:12.563539 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cca39e8-837a-4eee-a852-e5f7f02f1ffd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:12.564647 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cca39e8-837a-4eee-a852-e5f7f02f1ffd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:12.565702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8cca39e8-837a-4eee-a852-e5f7f02f1ffd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:12.644711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c6c84874-0970-4049-8d05-32949f896299 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:12.647193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c6c84874-0970-4049-8d05-32949f896299 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:12.663088 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6c84874-0970-4049-8d05-32949f896299 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:12.665733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6c84874-0970-4049-8d05-32949f896299 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:12.667528 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6c84874-0970-4049-8d05-32949f896299 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:12.668903 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6c84874-0970-4049-8d05-32949f896299 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:12.670402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6c84874-0970-4049-8d05-32949f896299 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:12.672712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6c84874-0970-4049-8d05-32949f896299 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:12.962873 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8cca39e8-837a-4eee-a852-e5f7f02f1ffd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:12.972851 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8cca39e8-837a-4eee-a852-e5f7f02f1ffd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1509 microversion: 2.1 time: 0.435733 Oct 14 17:57:12.975914 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 131/273] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:12 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1509 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:12.984512 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c6c84874-0970-4049-8d05-32949f896299 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:12.994133 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c6c84874-0970-4049-8d05-32949f896299 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.360699 Oct 14 17:57:12.995124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 143/274] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:12 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:13.255824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:13.256820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:13.264592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:13.265598 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:13.266531 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:13.267407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:13.268259 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:13.268873 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:13.454331 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:13.472201 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:13.474382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:13.482865 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f2ed50cf-a887-4704-929f-d87c6ea3f60d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.229545 Oct 14 17:57:13.500932 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 132/275] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:13 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:13.999677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ea3ec9f1-a0cb-431c-982d-9f76e57b8494 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:14.000160 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ea3ec9f1-a0cb-431c-982d-9f76e57b8494 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:14.008361 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ea3ec9f1-a0cb-431c-982d-9f76e57b8494 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:14.009804 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ea3ec9f1-a0cb-431c-982d-9f76e57b8494 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:14.010223 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ea3ec9f1-a0cb-431c-982d-9f76e57b8494 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:14.010942 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ea3ec9f1-a0cb-431c-982d-9f76e57b8494 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:14.011569 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ea3ec9f1-a0cb-431c-982d-9f76e57b8494 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:14.012124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ea3ec9f1-a0cb-431c-982d-9f76e57b8494 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:14.024767 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ec75a5ab-1798-4000-af54-191454f4a088 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:14.025951 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ec75a5ab-1798-4000-af54-191454f4a088 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:14.038038 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec75a5ab-1798-4000-af54-191454f4a088 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:14.038556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec75a5ab-1798-4000-af54-191454f4a088 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:14.038998 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec75a5ab-1798-4000-af54-191454f4a088 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:14.042570 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec75a5ab-1798-4000-af54-191454f4a088 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:14.043070 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec75a5ab-1798-4000-af54-191454f4a088 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:14.043504 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ec75a5ab-1798-4000-af54-191454f4a088 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:14.340540 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ea3ec9f1-a0cb-431c-982d-9f76e57b8494 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:14.349205 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ea3ec9f1-a0cb-431c-982d-9f76e57b8494 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1515 microversion: 2.1 time: 0.356236 Oct 14 17:57:14.353961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 144/276] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:13 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1515 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:14.414502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ec75a5ab-1798-4000-af54-191454f4a088 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:14.428051 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ec75a5ab-1798-4000-af54-191454f4a088 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.406926 Oct 14 17:57:14.429350 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 133/277] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:14 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:14.513299 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:14.513952 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:14.525554 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:14.526051 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:14.526490 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:14.527476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:14.527798 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:14.528251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:14.775275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:14.788219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:14.790564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:14.793711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-abf6b50e-5974-4f6e-8265-8e84a734aca5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.283141 Oct 14 17:57:14.795208 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 145/278] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:14 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:15.455213 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8fcb8827-0d25-424b-8897-3ed45ad9b429 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:15.456615 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8fcb8827-0d25-424b-8897-3ed45ad9b429 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:15.463393 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8fcb8827-0d25-424b-8897-3ed45ad9b429 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:15.463816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8fcb8827-0d25-424b-8897-3ed45ad9b429 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:15.464536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8fcb8827-0d25-424b-8897-3ed45ad9b429 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:15.465309 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8fcb8827-0d25-424b-8897-3ed45ad9b429 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:15.465839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8fcb8827-0d25-424b-8897-3ed45ad9b429 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:15.466368 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8fcb8827-0d25-424b-8897-3ed45ad9b429 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:15.695088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8fcb8827-0d25-424b-8897-3ed45ad9b429 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:15.704886 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8fcb8827-0d25-424b-8897-3ed45ad9b429 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.253652 Oct 14 17:57:15.717805 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 134/279] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:15 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:15.822291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:15.823574 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:15.833418 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:15.834419 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:15.835085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:15.841717 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:15.843023 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:15.843688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:15.957873 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-aeb97da7-fec4-4076-9aee-0a8ab0f1133f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'create', calling method: .version_select at 0x7fe3db4f4160>, body: {"keypair": {"name": "tempest-keypair-1946230769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQWwTSDtmY+mLxEXTqqFAM6pAkAamb5a9H45QC/a7OzuV8qbZPqWYCaDHV2J7Xw8AZBGeGT4YgtYi4s52IC3Iqhqte8iD/Sj94S9WPJ7IYUYwXklPdKWMeEVG0uZ75PBQ=="}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:15.974798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-aeb97da7-fec4-4076-9aee-0a8ab0f1133f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Getting quotas for project 530fdfc3448a40b7aa85170873d3f0ff. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:57:15.978657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-aeb97da7-fec4-4076-9aee-0a8ab0f1133f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Getting quotas for user c091bf027839447da4c713deb291ed1f and project 530fdfc3448a40b7aa85170873d3f0ff. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:57:16.024437 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-aeb97da7-fec4-4076-9aee-0a8ab0f1133f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070297 Oct 14 17:57:16.027320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 135/280] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Oct 14 17:57:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 17:57:16.198714 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:16.211932 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:16.215060 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:16.217997 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4e2c42e7-d579-4f1a-a679-2826f11e8a0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.399831 Oct 14 17:57:16.219564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 146/281] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:15 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:16.728942 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-17581f04-a7e0-4f24-8588-6431bda9ff29 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:16.730273 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-17581f04-a7e0-4f24-8588-6431bda9ff29 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:16.737684 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17581f04-a7e0-4f24-8588-6431bda9ff29 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:16.738532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17581f04-a7e0-4f24-8588-6431bda9ff29 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:16.739179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17581f04-a7e0-4f24-8588-6431bda9ff29 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:16.740142 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17581f04-a7e0-4f24-8588-6431bda9ff29 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:16.740820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17581f04-a7e0-4f24-8588-6431bda9ff29 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:16.741539 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17581f04-a7e0-4f24-8588-6431bda9ff29 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:17.242948 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-17581f04-a7e0-4f24-8588-6431bda9ff29 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:17.251481 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:17.252680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:17.257258 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-17581f04-a7e0-4f24-8588-6431bda9ff29 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.532691 Oct 14 17:57:17.259477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:17.260138 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:17.260720 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:17.261543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:17.262128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:17.262683 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:17.269326 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 136/282] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:16 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:17.519284 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:17.530468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:17.532098 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:17.533459 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c6b733f4-1804-4550-979a-92b4e7fa42bf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.287644 Oct 14 17:57:17.555850 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 147/283] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:17 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:17.867851 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-227586667", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9e10b55-ef20-4f9b-8608-899751152e31"}], "security_groups": [{"name": "tempest-securitygroup--1331971147"}], "key_name": "tempest-keypair-1946230769", "user_data": "}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:17.984696 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.network.neutron [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] validate_networks() for [('d9e10b55-ef20-4f9b-8608-899751152e31', None, None, None, None, None)] {{(pid=118656) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:57:18.285348 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-36d976a8-7416-4eeb-8a14-ae4d9cc0344c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:18.286818 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-36d976a8-7416-4eeb-8a14-ae4d9cc0344c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:18.297279 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36d976a8-7416-4eeb-8a14-ae4d9cc0344c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:18.297940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36d976a8-7416-4eeb-8a14-ae4d9cc0344c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:18.298538 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36d976a8-7416-4eeb-8a14-ae4d9cc0344c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:18.299502 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36d976a8-7416-4eeb-8a14-ae4d9cc0344c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:18.300197 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36d976a8-7416-4eeb-8a14-ae4d9cc0344c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:18.301398 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-36d976a8-7416-4eeb-8a14-ae4d9cc0344c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:18.535404 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-36d976a8-7416-4eeb-8a14-ae4d9cc0344c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:18.544160 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-36d976a8-7416-4eeb-8a14-ae4d9cc0344c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.263024 Oct 14 17:57:18.556502 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 148/284] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:18 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:18.570639 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Flavor limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:57:18.571057 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Image limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:57:18.571529 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Flavor pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:57:18.571953 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Image pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:57:18.572538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:57:18.578413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:18.579029 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:18.583021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:18.583505 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:18.584159 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:18.584895 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:18.585415 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:18.585847 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:18.586012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:18.586504 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:18.586938 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:18.588590 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:18.589114 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:18.589479 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:18.608654 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Getting quotas for project 530fdfc3448a40b7aa85170873d3f0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:57:18.619519 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Getting quotas for user c091bf027839447da4c713deb291ed1f and project 530fdfc3448a40b7aa85170873d3f0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:57:18.641295 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Going to run 1 instances... {{(pid=118656) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:57:18.643758 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118656) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:57:18.706352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-5f4235fe-0a58-47b0-9e57-8f4d43ae6c2e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.842626 Oct 14 17:57:18.713977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 137/285] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 17:57:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 17:57:18.721972 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c00dd220-665a-47fb-8f13-2c65ffdf081e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:18.724555 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c00dd220-665a-47fb-8f13-2c65ffdf081e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:18.839858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c00dd220-665a-47fb-8f13-2c65ffdf081e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:18.853178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c00dd220-665a-47fb-8f13-2c65ffdf081e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1245 microversion: 2.1 time: 0.137824 Oct 14 17:57:18.858858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 138/286] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:18 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1245 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:18.889803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:18.902467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:18.903995 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:18.905214 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-aa45944c-1275-4a53-966a-da1ef4404643 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.340616 Oct 14 17:57:18.912142 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 149/287] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:18 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:19.329530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4f6c8324-9b30-4cbc-bc42-335daad6432a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "668d9819-590b-437e-9519-d059ab5d3bee", "device": "/dev/sdb"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:19.332503 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4f6c8324-9b30-4cbc-bc42-335daad6432a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:19.339727 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4f6c8324-9b30-4cbc-bc42-335daad6432a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:19.340382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4f6c8324-9b30-4cbc-bc42-335daad6432a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:19.341378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4f6c8324-9b30-4cbc-bc42-335daad6432a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:19.342457 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4f6c8324-9b30-4cbc-bc42-335daad6432a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:19.343088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4f6c8324-9b30-4cbc-bc42-335daad6432a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:19.343646 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4f6c8324-9b30-4cbc-bc42-335daad6432a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:19.579633 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-92c86de7-7f89-4b9c-bdeb-90140ec1c6e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:19.580275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-92c86de7-7f89-4b9c-bdeb-90140ec1c6e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:19.586432 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92c86de7-7f89-4b9c-bdeb-90140ec1c6e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:19.586915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92c86de7-7f89-4b9c-bdeb-90140ec1c6e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:19.587345 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92c86de7-7f89-4b9c-bdeb-90140ec1c6e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:19.588069 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92c86de7-7f89-4b9c-bdeb-90140ec1c6e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:19.588517 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92c86de7-7f89-4b9c-bdeb-90140ec1c6e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:19.590234 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92c86de7-7f89-4b9c-bdeb-90140ec1c6e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:19.754770 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4f6c8324-9b30-4cbc-bc42-335daad6432a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "POST /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426803 Oct 14 17:57:19.755792 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 139/288] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 17:57:19 2022] POST /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:57:19.792452 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-92c86de7-7f89-4b9c-bdeb-90140ec1c6e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:19.810509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-92c86de7-7f89-4b9c-bdeb-90140ec1c6e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.235292 Oct 14 17:57:19.812240 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 150/289] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:19 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:19.877711 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3dee4e40-bbe1-48d7-922b-5fd7a9435da0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:19.878650 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3dee4e40-bbe1-48d7-922b-5fd7a9435da0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:19.888172 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3dee4e40-bbe1-48d7-922b-5fd7a9435da0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:19.888660 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3dee4e40-bbe1-48d7-922b-5fd7a9435da0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:19.889159 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3dee4e40-bbe1-48d7-922b-5fd7a9435da0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:19.889862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3dee4e40-bbe1-48d7-922b-5fd7a9435da0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:19.890345 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3dee4e40-bbe1-48d7-922b-5fd7a9435da0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:19.890800 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3dee4e40-bbe1-48d7-922b-5fd7a9435da0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:19.943255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:19.945183 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:19.957712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:19.959625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:19.960312 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:19.969002 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:19.972819 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:19.973488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:20.010714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3dee4e40-bbe1-48d7-922b-5fd7a9435da0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:20.020050 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3dee4e40-bbe1-48d7-922b-5fd7a9435da0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1297 microversion: 2.1 time: 0.147078 Oct 14 17:57:20.031999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 140/290] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:19 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:20.156555 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:20.167972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:20.173063 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:20.174451 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-220c9256-3430-43e0-bdca-fc94d5d1d1a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.235935 Oct 14 17:57:20.175185 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 151/291] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:19 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:20.838352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4e897469-60cf-4588-a2c9-ffc6a2290341 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:20.839639 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4e897469-60cf-4588-a2c9-ffc6a2290341 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:20.860738 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e897469-60cf-4588-a2c9-ffc6a2290341 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:20.861471 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e897469-60cf-4588-a2c9-ffc6a2290341 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:20.861906 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e897469-60cf-4588-a2c9-ffc6a2290341 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:20.862613 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e897469-60cf-4588-a2c9-ffc6a2290341 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:20.863065 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e897469-60cf-4588-a2c9-ffc6a2290341 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:20.863488 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e897469-60cf-4588-a2c9-ffc6a2290341 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:21.043034 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-56bc8891-b244-4175-b05a-90958257736f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:21.043642 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-56bc8891-b244-4175-b05a-90958257736f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:21.051340 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-56bc8891-b244-4175-b05a-90958257736f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:21.051753 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-56bc8891-b244-4175-b05a-90958257736f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:21.052208 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-56bc8891-b244-4175-b05a-90958257736f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:21.052907 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-56bc8891-b244-4175-b05a-90958257736f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:21.053349 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-56bc8891-b244-4175-b05a-90958257736f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:21.053938 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-56bc8891-b244-4175-b05a-90958257736f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:21.134772 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-4e897469-60cf-4588-a2c9-ffc6a2290341 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:21.146330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4e897469-60cf-4588-a2c9-ffc6a2290341 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.312322 Oct 14 17:57:21.147176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 141/292] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:20 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:21.168178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-56bc8891-b244-4175-b05a-90958257736f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:21.186653 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-56bc8891-b244-4175-b05a-90958257736f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1303 microversion: 2.1 time: 0.144926 Oct 14 17:57:21.194195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 152/293] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:21 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:21.205930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:21.206730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:21.215009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:21.215588 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:21.216151 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:21.216947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:21.218053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:21.219165 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:21.484243 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:21.500414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:21.502197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:21.504145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7fb36343-58b0-4101-bfc5-0a9a623bceb0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1745 microversion: 2.20 time: 0.304854 Oct 14 17:57:21.516315 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 142/294] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:21 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1745 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:22.178606 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d0d36cd9-9b66-4929-bdbb-0cf58f0bb90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:22.184635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d0d36cd9-9b66-4929-bdbb-0cf58f0bb90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:22.191676 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d0d36cd9-9b66-4929-bdbb-0cf58f0bb90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:22.192408 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d0d36cd9-9b66-4929-bdbb-0cf58f0bb90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:22.193018 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d0d36cd9-9b66-4929-bdbb-0cf58f0bb90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:22.193877 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d0d36cd9-9b66-4929-bdbb-0cf58f0bb90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:22.194474 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d0d36cd9-9b66-4929-bdbb-0cf58f0bb90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:22.196620 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d0d36cd9-9b66-4929-bdbb-0cf58f0bb90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:22.214770 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b70375ae-c6bb-4349-aab9-a4ee07409090 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:22.216561 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b70375ae-c6bb-4349-aab9-a4ee07409090 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:22.228310 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b70375ae-c6bb-4349-aab9-a4ee07409090 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:22.229114 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b70375ae-c6bb-4349-aab9-a4ee07409090 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:22.230082 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b70375ae-c6bb-4349-aab9-a4ee07409090 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:22.233862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b70375ae-c6bb-4349-aab9-a4ee07409090 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:22.234550 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b70375ae-c6bb-4349-aab9-a4ee07409090 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:22.235201 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b70375ae-c6bb-4349-aab9-a4ee07409090 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:22.576146 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d0d36cd9-9b66-4929-bdbb-0cf58f0bb90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:22.584475 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d0d36cd9-9b66-4929-bdbb-0cf58f0bb90c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1722 microversion: 2.1 time: 0.409742 Oct 14 17:57:22.585671 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 153/295] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:22 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:22.590446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:22.591296 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:22.598027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:22.599043 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:22.599690 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:22.600625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:22.601537 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:22.602171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:22.602847 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b70375ae-c6bb-4349-aab9-a4ee07409090 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:22.612510 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b70375ae-c6bb-4349-aab9-a4ee07409090 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.401697 Oct 14 17:57:22.632276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 143/296] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:22 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:22.866814 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:22.875822 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:22.877307 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:22.878482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-1eb3dad4-949f-4b2b-b5dd-5a8f2b103f0b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1745 microversion: 2.20 time: 0.291570 Oct 14 17:57:22.879036 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 154/297] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:22 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1745 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:23.109132 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-b012a405-34d2-4ad4-a1e5-ba135d778e9f req-abf09535-fe80-4978-8aea-7cff34a5b866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5", "tag": "6276aa8e-78da-45f2-9027-e54c0e8353b7"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:23.134404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-b012a405-34d2-4ad4-a1e5-ba135d778e9f req-abf09535-fe80-4978-8aea-7cff34a5b866 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:23.135271 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-b012a405-34d2-4ad4-a1e5-ba135d778e9f req-abf09535-fe80-4978-8aea-7cff34a5b866 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:23.136284 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-b012a405-34d2-4ad4-a1e5-ba135d778e9f req-abf09535-fe80-4978-8aea-7cff34a5b866 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:23.166544 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-b012a405-34d2-4ad4-a1e5-ba135d778e9f req-abf09535-fe80-4978-8aea-7cff34a5b866 service nova] Creating event network-changed:6276aa8e-78da-45f2-9027-e54c0e8353b7 for instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 on hv-cinder-74915 Oct 14 17:57:23.181943 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-b012a405-34d2-4ad4-a1e5-ba135d778e9f req-abf09535-fe80-4978-8aea-7cff34a5b866 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076211 Oct 14 17:57:23.184195 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 144/298] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:57:23.614844 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7be527e6-07c3-42ca-acd5-6cdd153b97c4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:23.615487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7be527e6-07c3-42ca-acd5-6cdd153b97c4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:23.624811 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7be527e6-07c3-42ca-acd5-6cdd153b97c4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:23.626760 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7be527e6-07c3-42ca-acd5-6cdd153b97c4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:23.628335 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7be527e6-07c3-42ca-acd5-6cdd153b97c4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:23.631117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7be527e6-07c3-42ca-acd5-6cdd153b97c4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:23.632248 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7be527e6-07c3-42ca-acd5-6cdd153b97c4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:23.633866 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7be527e6-07c3-42ca-acd5-6cdd153b97c4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:23.640706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fe1f452e-9dd7-4bc1-b41b-d70f99c3b461 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:23.642064 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fe1f452e-9dd7-4bc1-b41b-d70f99c3b461 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:23.653417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fe1f452e-9dd7-4bc1-b41b-d70f99c3b461 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:23.662946 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fe1f452e-9dd7-4bc1-b41b-d70f99c3b461 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:23.665666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fe1f452e-9dd7-4bc1-b41b-d70f99c3b461 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:23.667533 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fe1f452e-9dd7-4bc1-b41b-d70f99c3b461 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:23.668391 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fe1f452e-9dd7-4bc1-b41b-d70f99c3b461 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:23.674235 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fe1f452e-9dd7-4bc1-b41b-d70f99c3b461 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:23.948415 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fe1f452e-9dd7-4bc1-b41b-d70f99c3b461 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:23.958765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fe1f452e-9dd7-4bc1-b41b-d70f99c3b461 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.322678 Oct 14 17:57:23.960609 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 145/299] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:23 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:23.974401 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:23.978912 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:23.991295 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7be527e6-07c3-42ca-acd5-6cdd153b97c4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:24.011022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:24.011730 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7be527e6-07c3-42ca-acd5-6cdd153b97c4 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1699 microversion: 2.1 time: 0.399685 Oct 14 17:57:24.012403 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 155/300] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:23 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1699 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:24.013709 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:24.014367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:24.015240 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:24.015834 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:24.016424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:24.041618 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-86b0b87a-5886-447c-8e4d-a712d6a8634c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:24.052029 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-86b0b87a-5886-447c-8e4d-a712d6a8634c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:24.066165 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-86b0b87a-5886-447c-8e4d-a712d6a8634c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:24.066927 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-86b0b87a-5886-447c-8e4d-a712d6a8634c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:24.132344 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-86b0b87a-5886-447c-8e4d-a712d6a8634c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Going to try to start instance {{(pid=118655) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 14 17:57:24.276698 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-86b0b87a-5886-447c-8e4d-a712d6a8634c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/action" status: 202 len: 0 microversion: 2.1 time: 0.238697 Oct 14 17:57:24.277920 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 156/301] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:57:24 2022] POST /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:57:24.302313 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-28957b84-9ac1-42d9-92b9-41cdaae13204 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:24.303622 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-28957b84-9ac1-42d9-92b9-41cdaae13204 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:24.323407 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28957b84-9ac1-42d9-92b9-41cdaae13204 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:24.325994 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28957b84-9ac1-42d9-92b9-41cdaae13204 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:24.326660 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28957b84-9ac1-42d9-92b9-41cdaae13204 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:24.327610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28957b84-9ac1-42d9-92b9-41cdaae13204 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:24.329459 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28957b84-9ac1-42d9-92b9-41cdaae13204 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:24.346121 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28957b84-9ac1-42d9-92b9-41cdaae13204 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:24.399197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:24.406319 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:24.409395 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:24.414599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:24.422689 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a7848859-40a2-4b47-b5d6-3cb05288d6b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1740 microversion: 2.20 time: 0.459103 Oct 14 17:57:24.424060 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 146/302] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:23 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1740 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:24.632498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-28957b84-9ac1-42d9-92b9-41cdaae13204 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:24.642121 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-28957b84-9ac1-42d9-92b9-41cdaae13204 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1708 microversion: 2.1 time: 0.357902 Oct 14 17:57:24.645831 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 157/303] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:24 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1708 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:24.984136 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-98d53b87-d253-41a4-a537-ce3ac201975c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:24.984698 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-98d53b87-d253-41a4-a537-ce3ac201975c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:25.011222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98d53b87-d253-41a4-a537-ce3ac201975c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:25.021272 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98d53b87-d253-41a4-a537-ce3ac201975c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:25.022297 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98d53b87-d253-41a4-a537-ce3ac201975c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:25.025259 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98d53b87-d253-41a4-a537-ce3ac201975c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:25.025743 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98d53b87-d253-41a4-a537-ce3ac201975c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:25.027845 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98d53b87-d253-41a4-a537-ce3ac201975c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:25.227109 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-b3739940-4c76-4d17-a226-04617c32419e req-314a4c09-5c1f-4a07-9bcd-340cf408b2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c0a43e-1109-4ff9-9617-8a2958de7b0b", "name": "network-vif-plugged", "status": "completed", "tag": "04f9946a-535a-428e-8287-bac5d55cc781"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:25.259744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-b3739940-4c76-4d17-a226-04617c32419e req-314a4c09-5c1f-4a07-9bcd-340cf408b2db service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:25.263528 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-b3739940-4c76-4d17-a226-04617c32419e req-314a4c09-5c1f-4a07-9bcd-340cf408b2db service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:25.264339 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-b3739940-4c76-4d17-a226-04617c32419e req-314a4c09-5c1f-4a07-9bcd-340cf408b2db service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:25.284740 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-b3739940-4c76-4d17-a226-04617c32419e req-314a4c09-5c1f-4a07-9bcd-340cf408b2db service nova] Creating event network-vif-plugged:04f9946a-535a-428e-8287-bac5d55cc781 for instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b on hv-cinder-74915 Oct 14 17:57:25.305122 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-b3739940-4c76-4d17-a226-04617c32419e req-314a4c09-5c1f-4a07-9bcd-340cf408b2db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082331 Oct 14 17:57:25.309935 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 158/304] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 14 17:57:25.453726 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:25.455715 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:25.470351 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:25.472473 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:25.473151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:25.475268 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:25.475975 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:25.479255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:26.077858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-98d53b87-d253-41a4-a537-ce3ac201975c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:26.090537 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-98d53b87-d253-41a4-a537-ce3ac201975c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 1.111543 Oct 14 17:57:26.095927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 147/305] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:24 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:26.104659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-6da0ceec-bfaa-497d-82ed-501b493bebc2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:26.106045 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-6da0ceec-bfaa-497d-82ed-501b493bebc2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:26.118648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6da0ceec-bfaa-497d-82ed-501b493bebc2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:26.121104 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6da0ceec-bfaa-497d-82ed-501b493bebc2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:26.121796 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6da0ceec-bfaa-497d-82ed-501b493bebc2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:26.125960 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6da0ceec-bfaa-497d-82ed-501b493bebc2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:26.126682 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6da0ceec-bfaa-497d-82ed-501b493bebc2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:26.127443 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6da0ceec-bfaa-497d-82ed-501b493bebc2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:26.446827 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:26.458700 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:26.463052 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:26.468840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-98413a24-cbf2-4c52-9f2c-c745702473ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1740 microversion: 2.20 time: 1.020399 Oct 14 17:57:26.473231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 159/306] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:25 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1740 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:57:26.576137 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6da0ceec-bfaa-497d-82ed-501b493bebc2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:26.584660 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-6da0ceec-bfaa-497d-82ed-501b493bebc2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1708 microversion: 2.1 time: 0.487297 Oct 14 17:57:26.600540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 148/307] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:26 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1708 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:27.120435 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-cb375f63-622c-4add-9314-f6e268e62482 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:27.121026 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-cb375f63-622c-4add-9314-f6e268e62482 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:27.129969 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cb375f63-622c-4add-9314-f6e268e62482 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:27.135693 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cb375f63-622c-4add-9314-f6e268e62482 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:27.136963 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cb375f63-622c-4add-9314-f6e268e62482 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:27.137914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cb375f63-622c-4add-9314-f6e268e62482 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:27.138542 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cb375f63-622c-4add-9314-f6e268e62482 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:27.141797 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cb375f63-622c-4add-9314-f6e268e62482 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:27.497704 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:27.498312 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:27.503908 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-cb375f63-622c-4add-9314-f6e268e62482 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:27.513879 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-cb375f63-622c-4add-9314-f6e268e62482 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.395675 Oct 14 17:57:27.516212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:27.516699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:27.516826 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 160/308] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:27 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:27.517138 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:27.517852 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:27.518307 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:27.518730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:27.559699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:27.635307 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-921174fe-8624-4633-b20c-4583d4b02f66 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:27.636424 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-921174fe-8624-4633-b20c-4583d4b02f66 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:27.643765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-921174fe-8624-4633-b20c-4583d4b02f66 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:27.644590 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-921174fe-8624-4633-b20c-4583d4b02f66 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:27.645182 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-921174fe-8624-4633-b20c-4583d4b02f66 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:27.646053 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-921174fe-8624-4633-b20c-4583d4b02f66 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:27.646654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-921174fe-8624-4633-b20c-4583d4b02f66 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:27.647221 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-921174fe-8624-4633-b20c-4583d4b02f66 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:28.242418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:28.257042 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:28.259309 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:28.264641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fba82050-1571-4e91-a15c-d7abfde66e77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1740 microversion: 2.20 time: 0.770440 Oct 14 17:57:28.268382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 149/309] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:27 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1740 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:57:28.283939 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-921174fe-8624-4633-b20c-4583d4b02f66 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:28.294725 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-921174fe-8624-4633-b20c-4583d4b02f66 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1708 microversion: 2.1 time: 0.672962 Oct 14 17:57:28.296085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 161/310] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:27 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1708 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:28.542237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9bdc191c-f8a6-47db-bac0-ef61e8c3efe6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:28.543598 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9bdc191c-f8a6-47db-bac0-ef61e8c3efe6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:28.552645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bdc191c-f8a6-47db-bac0-ef61e8c3efe6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:28.553384 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bdc191c-f8a6-47db-bac0-ef61e8c3efe6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:28.554163 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bdc191c-f8a6-47db-bac0-ef61e8c3efe6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:28.555136 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bdc191c-f8a6-47db-bac0-ef61e8c3efe6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:28.564156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bdc191c-f8a6-47db-bac0-ef61e8c3efe6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:28.565194 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bdc191c-f8a6-47db-bac0-ef61e8c3efe6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:28.605470 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:28.750958 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-9bdc191c-f8a6-47db-bac0-ef61e8c3efe6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:28.759008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9bdc191c-f8a6-47db-bac0-ef61e8c3efe6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.224036 Oct 14 17:57:28.762028 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 150/311] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:28 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:29.293514 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:29.294658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:29.306268 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:29.314449 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:29.319526 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:29.320451 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:29.330930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e20231b0-7c82-4c00-af7f-aa642dc7c703 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:29.331690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e20231b0-7c82-4c00-af7f-aa642dc7c703 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:29.333724 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=12 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:29.336836 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:29.337582 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:29.354235 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e20231b0-7c82-4c00-af7f-aa642dc7c703 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:29.361343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e20231b0-7c82-4c00-af7f-aa642dc7c703 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:29.361343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e20231b0-7c82-4c00-af7f-aa642dc7c703 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:29.365522 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e20231b0-7c82-4c00-af7f-aa642dc7c703 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:29.368072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e20231b0-7c82-4c00-af7f-aa642dc7c703 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:29.371207 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e20231b0-7c82-4c00-af7f-aa642dc7c703 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:29.648515 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e20231b0-7c82-4c00-af7f-aa642dc7c703 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:29.658110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e20231b0-7c82-4c00-af7f-aa642dc7c703 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1708 microversion: 2.1 time: 0.332536 Oct 14 17:57:29.677139 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 151/312] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:29 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1708 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:29.707578 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:29.715616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:29.717082 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:29.726630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-490c9711-0f96-40b1-a31f-32102dfef51c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1740 microversion: 2.20 time: 0.437390 Oct 14 17:57:29.728566 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 162/313] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:29 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:29.788409 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-25233c43-b50a-434b-b38f-9cd3651ba6bb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:29.790174 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-25233c43-b50a-434b-b38f-9cd3651ba6bb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:29.801328 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-25233c43-b50a-434b-b38f-9cd3651ba6bb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:29.802161 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-25233c43-b50a-434b-b38f-9cd3651ba6bb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:29.802811 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-25233c43-b50a-434b-b38f-9cd3651ba6bb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:29.803714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-25233c43-b50a-434b-b38f-9cd3651ba6bb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:29.804388 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-25233c43-b50a-434b-b38f-9cd3651ba6bb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:29.805029 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-25233c43-b50a-434b-b38f-9cd3651ba6bb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:29.998121 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-25233c43-b50a-434b-b38f-9cd3651ba6bb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:30.009629 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-25233c43-b50a-434b-b38f-9cd3651ba6bb tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.226334 Oct 14 17:57:30.010890 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 152/314] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:29 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:30.686891 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4d26431f-fcd5-4129-a29e-c244365fa27f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:30.687585 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4d26431f-fcd5-4129-a29e-c244365fa27f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:30.693673 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d26431f-fcd5-4129-a29e-c244365fa27f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:30.694476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d26431f-fcd5-4129-a29e-c244365fa27f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:30.701759 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d26431f-fcd5-4129-a29e-c244365fa27f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:30.702885 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d26431f-fcd5-4129-a29e-c244365fa27f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:30.703581 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d26431f-fcd5-4129-a29e-c244365fa27f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:30.704241 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d26431f-fcd5-4129-a29e-c244365fa27f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:30.755056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:30.755719 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:30.776190 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:30.776683 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:30.777118 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:30.777839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:30.778291 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:30.778716 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:30.985549 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4d26431f-fcd5-4129-a29e-c244365fa27f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:31.016288 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4d26431f-fcd5-4129-a29e-c244365fa27f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1708 microversion: 2.1 time: 0.333240 Oct 14 17:57:31.032390 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 163/315] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:30 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1708 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:31.046560 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e8368a63-ef4a-4ff3-a550-f1e9998d50cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:31.047705 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e8368a63-ef4a-4ff3-a550-f1e9998d50cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:31.047849 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:31.057044 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:31.059115 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:31.060485 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e5a4a903-a52d-4653-83a9-25095238f3d5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1740 microversion: 2.20 time: 0.309877 Oct 14 17:57:31.061618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 153/316] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:30 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:31.065035 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e8368a63-ef4a-4ff3-a550-f1e9998d50cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:31.065785 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e8368a63-ef4a-4ff3-a550-f1e9998d50cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:31.066386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e8368a63-ef4a-4ff3-a550-f1e9998d50cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:31.067250 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e8368a63-ef4a-4ff3-a550-f1e9998d50cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:31.067850 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e8368a63-ef4a-4ff3-a550-f1e9998d50cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:31.068606 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e8368a63-ef4a-4ff3-a550-f1e9998d50cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:31.260295 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e8368a63-ef4a-4ff3-a550-f1e9998d50cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:31.269572 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e8368a63-ef4a-4ff3-a550-f1e9998d50cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.231192 Oct 14 17:57:31.271319 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 164/317] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:31 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:31.724263 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-218c63b6-bc8f-4dbc-ae6c-b39cd084df45 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Action: 'create', calling method: .version_select at 0x7fe3da98f5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1958202178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA5XhuJgctnFmbko8anfEi12ixi/7EnogwcvczZuDJJIjxKxYvLKTy+xYmrfgVjiW4XAAKqcR4U9SMg6r0ycRILB9P4Y3R71LR1d7CX559K9w5UQBiU9eXI/xAvLbXdRg=="}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:31.742608 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-218c63b6-bc8f-4dbc-ae6c-b39cd084df45 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Getting quotas for project f41c0e3b1239415ba4105ca5014cbe28. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:57:31.747181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-218c63b6-bc8f-4dbc-ae6c-b39cd084df45 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Getting quotas for user 01e84d6714b34da89292b2246b04d404 and project f41c0e3b1239415ba4105ca5014cbe28. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:57:31.757898 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:31.779040 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-218c63b6-bc8f-4dbc-ae6c-b39cd084df45 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058528 Oct 14 17:57:31.780650 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 154/318] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Oct 14 17:57:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:57:31.846770 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-826525805", "imageRef": "8c4618bd-8b3a-449d-abba-e907d6d91774", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1958202178", "networks": [{"uuid": "756a6544-0d40-4f61-8438-42aaa0ee03ce"}]}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:31.906315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] validate_networks() for [('756a6544-0d40-4f61-8438-42aaa0ee03ce', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:57:32.045467 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-71ee4f2a-468a-42ac-8a94-f534df0d9980 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:32.047233 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-71ee4f2a-468a-42ac-8a94-f534df0d9980 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:32.059867 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-71ee4f2a-468a-42ac-8a94-f534df0d9980 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:32.064517 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-71ee4f2a-468a-42ac-8a94-f534df0d9980 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:32.065128 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-71ee4f2a-468a-42ac-8a94-f534df0d9980 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:32.066000 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-71ee4f2a-468a-42ac-8a94-f534df0d9980 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:32.066643 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-71ee4f2a-468a-42ac-8a94-f534df0d9980 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:32.067217 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-71ee4f2a-468a-42ac-8a94-f534df0d9980 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:32.286458 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-71ee4f2a-468a-42ac-8a94-f534df0d9980 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:32.297599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-71ee4f2a-468a-42ac-8a94-f534df0d9980 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1712 microversion: 2.1 time: 0.256333 Oct 14 17:57:32.318629 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 155/319] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:32 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1712 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:32.325981 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:32.326841 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:32.334965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:32.335456 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:32.335900 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:32.336940 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:32.337381 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:32.337801 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:32.589773 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:32.602142 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:32.603813 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:32.605178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-542b2117-dab1-4cd7-80af-642cb3adab60 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1740 microversion: 2.20 time: 0.284435 Oct 14 17:57:32.619926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 156/320] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:32 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:32.620134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:57:32.620134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:57:32.620134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:57:32.620134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:57:32.620134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:57:32.621155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-92a4b13f-bcc0-4719-ab4d-946cdecd3b7b req-be092bbb-f271-4837-90c6-8073ad16dc66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5", "name": "network-vif-plugged", "status": "completed", "tag": "6276aa8e-78da-45f2-9027-e54c0e8353b7"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:32.621339 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=72 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:32.622026 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-92a4b13f-bcc0-4719-ab4d-946cdecd3b7b req-be092bbb-f271-4837-90c6-8073ad16dc66 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:32.622512 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-92a4b13f-bcc0-4719-ab4d-946cdecd3b7b req-be092bbb-f271-4837-90c6-8073ad16dc66 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:32.622974 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-92a4b13f-bcc0-4719-ab4d-946cdecd3b7b req-be092bbb-f271-4837-90c6-8073ad16dc66 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:32.632090 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:32.633453 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:32.634877 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:32.636600 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:32.638177 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:32.638827 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:32.641306 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-92a4b13f-bcc0-4719-ab4d-946cdecd3b7b req-be092bbb-f271-4837-90c6-8073ad16dc66 service nova] Creating event network-vif-plugged:6276aa8e-78da-45f2-9027-e54c0e8353b7 for instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 on hv-cinder-74915 Oct 14 17:57:32.646575 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-92a4b13f-bcc0-4719-ab4d-946cdecd3b7b req-be092bbb-f271-4837-90c6-8073ad16dc66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039007 Oct 14 17:57:32.650577 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 157/321] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:57:32.656793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0c62bd03-73e3-4c0a-a197-8342967216f2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:32.658451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0c62bd03-73e3-4c0a-a197-8342967216f2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:32.666860 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0c62bd03-73e3-4c0a-a197-8342967216f2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:32.667355 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0c62bd03-73e3-4c0a-a197-8342967216f2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:32.667833 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0c62bd03-73e3-4c0a-a197-8342967216f2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:32.668656 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0c62bd03-73e3-4c0a-a197-8342967216f2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:32.669150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0c62bd03-73e3-4c0a-a197-8342967216f2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:32.669831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0c62bd03-73e3-4c0a-a197-8342967216f2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:32.688235 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Getting quotas for project f41c0e3b1239415ba4105ca5014cbe28. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:57:32.695205 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Getting quotas for user 01e84d6714b34da89292b2246b04d404 and project f41c0e3b1239415ba4105ca5014cbe28. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:57:32.711911 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:57:32.714297 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c4618bd-8b3a-449d-abba-e907d6d91774',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:57:32.786354 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-adbae531-a634-4af7-b0ee-924ed1712b50 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944413 Oct 14 17:57:32.788182 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 165/322] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 17:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 17:57:32.801360 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-760a1cee-c2f3-4059-8512-7db9735fa4a3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:32.802508 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-760a1cee-c2f3-4059-8512-7db9735fa4a3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:32.989227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-760a1cee-c2f3-4059-8512-7db9735fa4a3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:33.001922 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-760a1cee-c2f3-4059-8512-7db9735fa4a3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1258 microversion: 2.1 time: 0.206268 Oct 14 17:57:33.020984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0c62bd03-73e3-4c0a-a197-8342967216f2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:33.033173 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 166/323] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:32 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1258 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:33.033762 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0c62bd03-73e3-4c0a-a197-8342967216f2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.380064 Oct 14 17:57:33.039902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 158/324] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:32 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:33.635455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:33.636334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:33.642811 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:33.643542 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:33.644236 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:33.645491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:33.645632 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:33.646324 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:33.805779 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:33.815168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:33.816659 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:33.817827 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-90384039-edeb-465c-b2cb-70f2ccc7b45b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1740 microversion: 2.20 time: 0.186278 Oct 14 17:57:33.836326 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 167/325] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:33 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:34.025893 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9dacdc7f-a794-4f01-b7e1-6984d01c57f0 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:34.027199 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9dacdc7f-a794-4f01-b7e1-6984d01c57f0 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:34.034661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dacdc7f-a794-4f01-b7e1-6984d01c57f0 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:34.035143 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dacdc7f-a794-4f01-b7e1-6984d01c57f0 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:34.035576 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dacdc7f-a794-4f01-b7e1-6984d01c57f0 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:34.036304 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dacdc7f-a794-4f01-b7e1-6984d01c57f0 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:34.036758 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dacdc7f-a794-4f01-b7e1-6984d01c57f0 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:34.037431 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dacdc7f-a794-4f01-b7e1-6984d01c57f0 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:34.062491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9f646fb8-1eb5-4fd9-b598-45b85f7d25ee tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:34.063098 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9f646fb8-1eb5-4fd9-b598-45b85f7d25ee tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:34.071537 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f646fb8-1eb5-4fd9-b598-45b85f7d25ee tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:34.072333 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f646fb8-1eb5-4fd9-b598-45b85f7d25ee tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:34.072953 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f646fb8-1eb5-4fd9-b598-45b85f7d25ee tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:34.073833 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f646fb8-1eb5-4fd9-b598-45b85f7d25ee tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:34.074584 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f646fb8-1eb5-4fd9-b598-45b85f7d25ee tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:34.075162 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f646fb8-1eb5-4fd9-b598-45b85f7d25ee tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:34.113869 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-9dacdc7f-a794-4f01-b7e1-6984d01c57f0 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:34.124048 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9dacdc7f-a794-4f01-b7e1-6984d01c57f0 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1262 microversion: 2.1 time: 0.101843 Oct 14 17:57:34.124636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 159/326] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:34 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1262 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:34.251237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9f646fb8-1eb5-4fd9-b598-45b85f7d25ee tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:34.260884 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9f646fb8-1eb5-4fd9-b598-45b85f7d25ee tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.202121 Oct 14 17:57:34.261644 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 168/327] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:34 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:34.843058 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:34.843957 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:34.850319 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:34.851058 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:34.851695 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:34.852688 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:34.855699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:34.855699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:35.000167 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:35.009379 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:35.010872 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:35.012062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1ad56474-8621-49a4-9bbb-ca3a80d764ca tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1740 microversion: 2.20 time: 0.173388 Oct 14 17:57:35.012609 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 160/328] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:34 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:35.150096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b205520e-50df-484a-9ca4-efdb84abaf2a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:35.150666 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b205520e-50df-484a-9ca4-efdb84abaf2a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:35.157081 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b205520e-50df-484a-9ca4-efdb84abaf2a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:35.157562 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b205520e-50df-484a-9ca4-efdb84abaf2a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:35.157989 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b205520e-50df-484a-9ca4-efdb84abaf2a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:35.158871 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b205520e-50df-484a-9ca4-efdb84abaf2a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:35.159317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b205520e-50df-484a-9ca4-efdb84abaf2a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:35.159730 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b205520e-50df-484a-9ca4-efdb84abaf2a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:35.231609 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b205520e-50df-484a-9ca4-efdb84abaf2a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:35.239745 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b205520e-50df-484a-9ca4-efdb84abaf2a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1262 microversion: 2.1 time: 0.093533 Oct 14 17:57:35.240334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 169/329] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:35 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:35.284100 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a72589c8-a01a-478b-9758-4693a214efc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:35.285401 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a72589c8-a01a-478b-9758-4693a214efc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:35.292356 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a72589c8-a01a-478b-9758-4693a214efc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:35.293210 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a72589c8-a01a-478b-9758-4693a214efc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:35.293705 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a72589c8-a01a-478b-9758-4693a214efc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:35.294456 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a72589c8-a01a-478b-9758-4693a214efc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:35.294970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a72589c8-a01a-478b-9758-4693a214efc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:35.295476 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a72589c8-a01a-478b-9758-4693a214efc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:35.438508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a72589c8-a01a-478b-9758-4693a214efc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:35.446401 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a72589c8-a01a-478b-9758-4693a214efc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.166642 Oct 14 17:57:35.447181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 161/330] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:35 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:36.042556 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:36.043162 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:36.049942 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:36.050416 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:36.050851 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:36.051543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:36.052043 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:36.052466 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:36.177855 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:36.185781 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:36.188364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:36.189498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ef82c6e6-6292-42e5-b53f-22541cb74598 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1740 microversion: 2.20 time: 0.150768 Oct 14 17:57:36.190046 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 170/331] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:36 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:36.263714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9edaa558-41fc-4e3e-b2b7-d03f3897e5c5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:36.264319 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9edaa558-41fc-4e3e-b2b7-d03f3897e5c5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:36.270541 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9edaa558-41fc-4e3e-b2b7-d03f3897e5c5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:36.271020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9edaa558-41fc-4e3e-b2b7-d03f3897e5c5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:36.271463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9edaa558-41fc-4e3e-b2b7-d03f3897e5c5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:36.272179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9edaa558-41fc-4e3e-b2b7-d03f3897e5c5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:36.272631 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9edaa558-41fc-4e3e-b2b7-d03f3897e5c5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:36.273050 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9edaa558-41fc-4e3e-b2b7-d03f3897e5c5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:36.336575 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-9edaa558-41fc-4e3e-b2b7-d03f3897e5c5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:36.345196 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9edaa558-41fc-4e3e-b2b7-d03f3897e5c5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1262 microversion: 2.1 time: 0.085296 Oct 14 17:57:36.345772 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 162/332] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:36 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:36.469766 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-13ff1773-4b06-49cd-b0ff-59b035b1be3d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:36.470403 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-13ff1773-4b06-49cd-b0ff-59b035b1be3d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:36.476287 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13ff1773-4b06-49cd-b0ff-59b035b1be3d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:36.476774 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13ff1773-4b06-49cd-b0ff-59b035b1be3d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:36.477208 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13ff1773-4b06-49cd-b0ff-59b035b1be3d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:36.477896 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13ff1773-4b06-49cd-b0ff-59b035b1be3d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:36.478351 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13ff1773-4b06-49cd-b0ff-59b035b1be3d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:36.478803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13ff1773-4b06-49cd-b0ff-59b035b1be3d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:36.609527 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-13ff1773-4b06-49cd-b0ff-59b035b1be3d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:36.617115 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-13ff1773-4b06-49cd-b0ff-59b035b1be3d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.151805 Oct 14 17:57:36.617663 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 171/333] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:36 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:37.215375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:37.215512 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:37.223166 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:37.223809 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:37.224592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:37.225392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:37.225850 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:37.226272 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:37.355990 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:37.364714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:37.366165 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:37.367285 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-630fa4ac-4fe7-4141-b61e-df180db28c16 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1740 microversion: 2.20 time: 0.156478 Oct 14 17:57:37.367855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 163/334] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:37 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:37.369081 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7d9e5ddd-2a06-4d13-a3dd-4dad45e34916 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:37.369681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7d9e5ddd-2a06-4d13-a3dd-4dad45e34916 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:37.376231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7d9e5ddd-2a06-4d13-a3dd-4dad45e34916 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:37.376756 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7d9e5ddd-2a06-4d13-a3dd-4dad45e34916 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:37.377187 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7d9e5ddd-2a06-4d13-a3dd-4dad45e34916 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:37.377867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7d9e5ddd-2a06-4d13-a3dd-4dad45e34916 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:37.378447 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7d9e5ddd-2a06-4d13-a3dd-4dad45e34916 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:37.378889 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7d9e5ddd-2a06-4d13-a3dd-4dad45e34916 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:37.442455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7d9e5ddd-2a06-4d13-a3dd-4dad45e34916 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:37.449972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7d9e5ddd-2a06-4d13-a3dd-4dad45e34916 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1310 microversion: 2.1 time: 0.084771 Oct 14 17:57:37.450546 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 172/335] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:37 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:37.640855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0b744b60-0256-47b9-bfcd-26bd618d5f23 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:37.641374 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0b744b60-0256-47b9-bfcd-26bd618d5f23 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:37.647179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b744b60-0256-47b9-bfcd-26bd618d5f23 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:37.647649 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b744b60-0256-47b9-bfcd-26bd618d5f23 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:37.648133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b744b60-0256-47b9-bfcd-26bd618d5f23 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:37.648810 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b744b60-0256-47b9-bfcd-26bd618d5f23 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:37.649256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b744b60-0256-47b9-bfcd-26bd618d5f23 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:37.649671 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b744b60-0256-47b9-bfcd-26bd618d5f23 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:37.778548 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0b744b60-0256-47b9-bfcd-26bd618d5f23 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:37.786891 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0b744b60-0256-47b9-bfcd-26bd618d5f23 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.150889 Oct 14 17:57:37.787712 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 164/336] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:37 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:38.392925 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:38.393458 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:38.399392 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:38.399869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:38.400326 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:38.401010 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:38.401455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:38.401872 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:38.472063 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-415278b2-b80a-41f9-a424-9718e279fbbb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:38.472719 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-415278b2-b80a-41f9-a424-9718e279fbbb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:38.479040 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-415278b2-b80a-41f9-a424-9718e279fbbb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:38.479522 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-415278b2-b80a-41f9-a424-9718e279fbbb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:38.479973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-415278b2-b80a-41f9-a424-9718e279fbbb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:38.480739 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-415278b2-b80a-41f9-a424-9718e279fbbb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:38.481192 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-415278b2-b80a-41f9-a424-9718e279fbbb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:38.481613 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-415278b2-b80a-41f9-a424-9718e279fbbb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:38.551760 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-415278b2-b80a-41f9-a424-9718e279fbbb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:38.555033 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:38.559267 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-415278b2-b80a-41f9-a424-9718e279fbbb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1310 microversion: 2.1 time: 0.091086 Oct 14 17:57:38.559845 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 165/337] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:38 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:38.563640 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:38.565157 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:38.566412 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-01f0e154-fff9-4012-a6fd-271ac751e96b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.177541 Oct 14 17:57:38.566959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 173/338] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:38 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:38.809545 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f9d9c36f-0727-4bca-b1b7-3ae3352704f0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:38.810149 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f9d9c36f-0727-4bca-b1b7-3ae3352704f0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:38.817048 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f9d9c36f-0727-4bca-b1b7-3ae3352704f0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:38.817516 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f9d9c36f-0727-4bca-b1b7-3ae3352704f0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:38.817947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f9d9c36f-0727-4bca-b1b7-3ae3352704f0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:38.818651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f9d9c36f-0727-4bca-b1b7-3ae3352704f0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:38.819087 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f9d9c36f-0727-4bca-b1b7-3ae3352704f0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:38.819505 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f9d9c36f-0727-4bca-b1b7-3ae3352704f0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:38.948632 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f9d9c36f-0727-4bca-b1b7-3ae3352704f0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:38.957653 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f9d9c36f-0727-4bca-b1b7-3ae3352704f0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1371 microversion: 2.1 time: 0.151997 Oct 14 17:57:38.958221 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 166/339] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:38 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:39.582317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-82702869-6cee-457b-b086-53155698d32b tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:39.582922 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-82702869-6cee-457b-b086-53155698d32b tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:39.589168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-82702869-6cee-457b-b086-53155698d32b tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:39.589648 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-82702869-6cee-457b-b086-53155698d32b tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:39.590081 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-82702869-6cee-457b-b086-53155698d32b tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:39.590768 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-82702869-6cee-457b-b086-53155698d32b tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:39.591248 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-82702869-6cee-457b-b086-53155698d32b tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:39.591668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-82702869-6cee-457b-b086-53155698d32b tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:39.592118 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:39.593358 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:39.599744 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:39.600262 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:39.600692 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:39.601375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:39.601822 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:39.602239 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:39.653605 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-82702869-6cee-457b-b086-53155698d32b tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:39.662315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-82702869-6cee-457b-b086-53155698d32b tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1310 microversion: 2.1 time: 0.083527 Oct 14 17:57:39.662882 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 174/340] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:39 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:39.748766 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:39.752214 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=100 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:39.757690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:39.759116 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:39.760274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e51e9ef8-bc64-4b2c-8cd6-352a2072ae03 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.171967 Oct 14 17:57:39.760825 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 167/341] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:39 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:57:39.980990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-62bcc58e-b263-409b-8da4-581f8a80347a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:39.981515 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-62bcc58e-b263-409b-8da4-581f8a80347a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:39.988174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-62bcc58e-b263-409b-8da4-581f8a80347a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:39.988662 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-62bcc58e-b263-409b-8da4-581f8a80347a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:39.989096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-62bcc58e-b263-409b-8da4-581f8a80347a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:39.989781 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-62bcc58e-b263-409b-8da4-581f8a80347a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:39.990261 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-62bcc58e-b263-409b-8da4-581f8a80347a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:39.990681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-62bcc58e-b263-409b-8da4-581f8a80347a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:40.117835 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-62bcc58e-b263-409b-8da4-581f8a80347a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:40.125688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-62bcc58e-b263-409b-8da4-581f8a80347a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1565 microversion: 2.1 time: 0.148569 Oct 14 17:57:40.126243 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 175/342] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:39 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:40.149292 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-68611618-4f67-48c3-8ba3-05efe9c3d3d0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:40.149784 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-68611618-4f67-48c3-8ba3-05efe9c3d3d0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:40.156669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-68611618-4f67-48c3-8ba3-05efe9c3d3d0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:40.157150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-68611618-4f67-48c3-8ba3-05efe9c3d3d0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:40.157581 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-68611618-4f67-48c3-8ba3-05efe9c3d3d0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:40.158269 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-68611618-4f67-48c3-8ba3-05efe9c3d3d0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:40.158719 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-68611618-4f67-48c3-8ba3-05efe9c3d3d0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:40.159143 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-68611618-4f67-48c3-8ba3-05efe9c3d3d0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:40.232750 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-68611618-4f67-48c3-8ba3-05efe9c3d3d0 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087349 Oct 14 17:57:40.233345 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 168/343] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Oct 14 17:57:40 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:57:40.685991 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c0c909d2-0984-4869-b522-ddd70bbfc557 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:40.687487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c0c909d2-0984-4869-b522-ddd70bbfc557 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:40.693739 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0c909d2-0984-4869-b522-ddd70bbfc557 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:40.694223 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0c909d2-0984-4869-b522-ddd70bbfc557 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:40.694654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0c909d2-0984-4869-b522-ddd70bbfc557 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:40.695345 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0c909d2-0984-4869-b522-ddd70bbfc557 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:40.695794 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0c909d2-0984-4869-b522-ddd70bbfc557 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:40.696248 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0c909d2-0984-4869-b522-ddd70bbfc557 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:40.715518 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=100 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:40.769024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c0c909d2-0984-4869-b522-ddd70bbfc557 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:40.777109 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c0c909d2-0984-4869-b522-ddd70bbfc557 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1310 microversion: 2.1 time: 0.094895 Oct 14 17:57:40.778619 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 176/344] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:40 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:40.786363 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:40.787487 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:40.793804 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:40.794465 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:40.794971 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:40.796837 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:40.796946 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:40.797365 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:40.938402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-40e23805-7b90-48ab-94d1-37039043d55b req-b0d32e82-9378-4bf1-9f8a-f26577c19e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c0a43e-1109-4ff9-9617-8a2958de7b0b", "name": "network-vif-unplugged", "status": "completed", "tag": "04f9946a-535a-428e-8287-bac5d55cc781"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:40.951663 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-40e23805-7b90-48ab-94d1-37039043d55b req-b0d32e82-9378-4bf1-9f8a-f26577c19e2c service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:40.954196 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-40e23805-7b90-48ab-94d1-37039043d55b req-b0d32e82-9378-4bf1-9f8a-f26577c19e2c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:40.954704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-40e23805-7b90-48ab-94d1-37039043d55b req-b0d32e82-9378-4bf1-9f8a-f26577c19e2c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:40.969838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-40e23805-7b90-48ab-94d1-37039043d55b req-b0d32e82-9378-4bf1-9f8a-f26577c19e2c service nova] Creating event network-vif-unplugged:04f9946a-535a-428e-8287-bac5d55cc781 for instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b on hv-cinder-74915 Oct 14 17:57:40.974997 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-40e23805-7b90-48ab-94d1-37039043d55b req-b0d32e82-9378-4bf1-9f8a-f26577c19e2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041044 Oct 14 17:57:40.975865 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 177/345] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 17:57:41.112731 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:41.121128 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:41.122611 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:41.124288 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c9369626-472c-43e7-bdbd-8ae2ce7a27bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.341704 Oct 14 17:57:41.124970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 169/346] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:40 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:57:41.801831 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e4e8d730-21e9-4f43-aa0d-c160155a4598 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:41.802561 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e4e8d730-21e9-4f43-aa0d-c160155a4598 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:41.808714 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4e8d730-21e9-4f43-aa0d-c160155a4598 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:41.809192 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4e8d730-21e9-4f43-aa0d-c160155a4598 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:41.809624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4e8d730-21e9-4f43-aa0d-c160155a4598 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:41.810367 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4e8d730-21e9-4f43-aa0d-c160155a4598 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:41.810817 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4e8d730-21e9-4f43-aa0d-c160155a4598 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:41.811232 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e4e8d730-21e9-4f43-aa0d-c160155a4598 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:41.844616 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-bda80a51-73aa-45ea-8459-8a02df5a9b7c req-7cc4878b-907a-4c82-8351-3e3b5c180049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5", "tag": "6276aa8e-78da-45f2-9027-e54c0e8353b7"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:41.853975 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=4 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:41.857627 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-bda80a51-73aa-45ea-8459-8a02df5a9b7c req-7cc4878b-907a-4c82-8351-3e3b5c180049 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:41.859053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-bda80a51-73aa-45ea-8459-8a02df5a9b7c req-7cc4878b-907a-4c82-8351-3e3b5c180049 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:41.859709 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-bda80a51-73aa-45ea-8459-8a02df5a9b7c req-7cc4878b-907a-4c82-8351-3e3b5c180049 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:41.874178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-bda80a51-73aa-45ea-8459-8a02df5a9b7c req-7cc4878b-907a-4c82-8351-3e3b5c180049 service nova] Creating event network-changed:6276aa8e-78da-45f2-9027-e54c0e8353b7 for instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 on hv-cinder-74915 Oct 14 17:57:41.882876 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-bda80a51-73aa-45ea-8459-8a02df5a9b7c req-7cc4878b-907a-4c82-8351-3e3b5c180049 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040951 Oct 14 17:57:41.884082 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 170/347] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:57:41.919725 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e4e8d730-21e9-4f43-aa0d-c160155a4598 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:41.929685 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e4e8d730-21e9-4f43-aa0d-c160155a4598 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1310 microversion: 2.1 time: 0.131914 Oct 14 17:57:41.930774 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 178/348] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:41 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:42.157756 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:42.160758 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:42.170090 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:42.170964 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:42.171669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:42.172798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:42.173509 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:42.174084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:42.759676 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:42.772822 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:42.776811 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:42.778360 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-796d4766-69a3-47f5-acaf-d2291eb933c0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.631872 Oct 14 17:57:42.781780 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 171/349] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:42 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:42.961909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-26ea8724-4989-42cd-9a9a-b530ca0e43ce tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:42.963965 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-26ea8724-4989-42cd-9a9a-b530ca0e43ce tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:42.973640 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:42.976477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26ea8724-4989-42cd-9a9a-b530ca0e43ce tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:42.977450 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26ea8724-4989-42cd-9a9a-b530ca0e43ce tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:42.978472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26ea8724-4989-42cd-9a9a-b530ca0e43ce tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:42.979444 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26ea8724-4989-42cd-9a9a-b530ca0e43ce tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:42.980863 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26ea8724-4989-42cd-9a9a-b530ca0e43ce tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:42.982412 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26ea8724-4989-42cd-9a9a-b530ca0e43ce tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:43.005383 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=8 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:43.223860 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-26ea8724-4989-42cd-9a9a-b530ca0e43ce tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:43.243286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-26ea8724-4989-42cd-9a9a-b530ca0e43ce tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.278821 Oct 14 17:57:43.245320 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 179/350] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:42 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:43.810328 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:43.811910 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:43.821684 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:43.824882 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:43.825758 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:43.827954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:43.829309 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:43.829812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:43.974108 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:43.982699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:43.984818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:43.985941 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-38579032-6dea-4895-b00f-197014a7f07f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.179665 Oct 14 17:57:43.986497 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 172/351] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:43 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:44.267636 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-06b54810-0551-4952-bb72-70bce8e2b963 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:44.268286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-06b54810-0551-4952-bb72-70bce8e2b963 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:44.281189 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06b54810-0551-4952-bb72-70bce8e2b963 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:44.281777 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06b54810-0551-4952-bb72-70bce8e2b963 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:44.282302 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06b54810-0551-4952-bb72-70bce8e2b963 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:44.283093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06b54810-0551-4952-bb72-70bce8e2b963 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:44.283619 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06b54810-0551-4952-bb72-70bce8e2b963 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:44.284147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-06b54810-0551-4952-bb72-70bce8e2b963 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:44.432695 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-06b54810-0551-4952-bb72-70bce8e2b963 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:44.441039 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-06b54810-0551-4952-bb72-70bce8e2b963 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.177385 Oct 14 17:57:44.441637 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 180/352] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:44 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:44.861646 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a60dc5a6-70be-4163-ab04-dcaddc765435 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:44.862189 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a60dc5a6-70be-4163-ab04-dcaddc765435 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:44.868874 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a60dc5a6-70be-4163-ab04-dcaddc765435 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:44.869361 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a60dc5a6-70be-4163-ab04-dcaddc765435 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:44.869787 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a60dc5a6-70be-4163-ab04-dcaddc765435 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:44.870475 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a60dc5a6-70be-4163-ab04-dcaddc765435 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:44.870916 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a60dc5a6-70be-4163-ab04-dcaddc765435 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:44.871326 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a60dc5a6-70be-4163-ab04-dcaddc765435 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:45.007901 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-a60dc5a6-70be-4163-ab04-dcaddc765435 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lazy-loading 'services' on Instance uuid 540e714d-90e7-4e09-b976-07d53f7a8444 {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:57:45.012235 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:45.012839 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:45.020093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:45.020655 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:45.021096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:45.021806 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:45.022253 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:45.022679 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:45.159599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a60dc5a6-70be-4163-ab04-dcaddc765435 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444/os-volume_attachments/668d9819-590b-437e-9519-d059ab5d3bee" status: 202 len: 0 microversion: 2.1 time: 0.302281 Oct 14 17:57:45.160519 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 173/353] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 17:57:44 2022] DELETE /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444/os-volume_attachments/668d9819-590b-437e-9519-d059ab5d3bee => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:57:45.185495 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:45.196770 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:45.199172 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:45.200772 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-08117cfa-969d-478f-b145-156acb9bab7c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.192487 Oct 14 17:57:45.202551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 181/354] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:45 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:57:45.466692 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-da5b2332-cff9-4ece-a0b5-4155ab05d46e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:45.470498 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-da5b2332-cff9-4ece-a0b5-4155ab05d46e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:45.478749 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da5b2332-cff9-4ece-a0b5-4155ab05d46e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:45.479244 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da5b2332-cff9-4ece-a0b5-4155ab05d46e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:45.479912 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da5b2332-cff9-4ece-a0b5-4155ab05d46e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:45.480631 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da5b2332-cff9-4ece-a0b5-4155ab05d46e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:45.481087 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da5b2332-cff9-4ece-a0b5-4155ab05d46e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:45.481502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da5b2332-cff9-4ece-a0b5-4155ab05d46e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:45.632521 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-da5b2332-cff9-4ece-a0b5-4155ab05d46e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:45.641258 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-da5b2332-cff9-4ece-a0b5-4155ab05d46e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.179413 Oct 14 17:57:45.642009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 174/355] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:45 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:46.227748 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:46.228548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:46.234489 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:46.234976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:46.235409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:46.236161 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:46.236612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:46.237070 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:46.387965 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:46.398371 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:46.399936 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:46.401269 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b3c71d69-9400-43bd-b5d3-397bbc7537ac tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.177430 Oct 14 17:57:46.401907 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 182/356] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:46 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:46.664600 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-dd315ab3-e2b1-4d9c-9837-96c5ab76f71d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:46.665368 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-dd315ab3-e2b1-4d9c-9837-96c5ab76f71d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:46.672179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd315ab3-e2b1-4d9c-9837-96c5ab76f71d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:46.672730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd315ab3-e2b1-4d9c-9837-96c5ab76f71d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:46.673176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd315ab3-e2b1-4d9c-9837-96c5ab76f71d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:46.673960 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd315ab3-e2b1-4d9c-9837-96c5ab76f71d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:46.674533 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd315ab3-e2b1-4d9c-9837-96c5ab76f71d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:46.675016 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dd315ab3-e2b1-4d9c-9837-96c5ab76f71d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:46.806943 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-dd315ab3-e2b1-4d9c-9837-96c5ab76f71d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:46.814916 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-dd315ab3-e2b1-4d9c-9837-96c5ab76f71d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.154472 Oct 14 17:57:46.815509 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 175/357] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:46 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:47.429397 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:47.430054 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:47.435852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:47.437015 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:47.437493 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:47.438237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:47.438691 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:47.439115 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:47.582141 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:47.590573 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:47.592038 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:47.593458 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-98a3a434-75c1-4769-b976-dd9029a37b93 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.167996 Oct 14 17:57:47.594203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 183/358] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:47 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:47.839084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8282a65c-2d0d-4ffe-b97c-75434e678505 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:47.839723 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8282a65c-2d0d-4ffe-b97c-75434e678505 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:47.847759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8282a65c-2d0d-4ffe-b97c-75434e678505 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:47.848363 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8282a65c-2d0d-4ffe-b97c-75434e678505 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:47.848859 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8282a65c-2d0d-4ffe-b97c-75434e678505 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:47.849620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8282a65c-2d0d-4ffe-b97c-75434e678505 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:47.850164 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8282a65c-2d0d-4ffe-b97c-75434e678505 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:47.850635 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8282a65c-2d0d-4ffe-b97c-75434e678505 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:48.004739 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8282a65c-2d0d-4ffe-b97c-75434e678505 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:48.012465 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8282a65c-2d0d-4ffe-b97c-75434e678505 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.177588 Oct 14 17:57:48.013020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 176/359] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:47 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:48.618774 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:48.619385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:48.625554 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:48.626038 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:48.626468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:48.627167 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:48.627658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:48.628082 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:48.782799 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:48.794597 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:48.798909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:48.799061 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8f38c671-b198-4823-8883-e7b4c6e32b45 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.184141 Oct 14 17:57:48.799494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 184/360] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:48 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:49.036719 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f47ef7ae-d2b1-4c17-8cf7-edb3a967ed32 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:49.039012 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f47ef7ae-d2b1-4c17-8cf7-edb3a967ed32 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:49.044727 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f47ef7ae-d2b1-4c17-8cf7-edb3a967ed32 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:49.045179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f47ef7ae-d2b1-4c17-8cf7-edb3a967ed32 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:49.045847 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f47ef7ae-d2b1-4c17-8cf7-edb3a967ed32 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:49.047899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f47ef7ae-d2b1-4c17-8cf7-edb3a967ed32 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:49.048355 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f47ef7ae-d2b1-4c17-8cf7-edb3a967ed32 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:49.048777 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f47ef7ae-d2b1-4c17-8cf7-edb3a967ed32 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:49.259274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f47ef7ae-d2b1-4c17-8cf7-edb3a967ed32 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:49.269425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f47ef7ae-d2b1-4c17-8cf7-edb3a967ed32 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.236565 Oct 14 17:57:49.270122 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 177/361] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:49 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:49.829159 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:49.829784 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:49.835735 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:49.836249 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:49.836680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:49.837377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:49.837824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:49.838251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:49.986825 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:49.996230 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:49.997674 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:49.999727 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a6eb1ed6-79f5-4cb1-b0f6-669e04910169 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.174456 Oct 14 17:57:50.005664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 185/362] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:49 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:50.294435 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fa4d7048-8414-46aa-bde1-09574be7273d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:50.295164 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fa4d7048-8414-46aa-bde1-09574be7273d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:50.301760 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa4d7048-8414-46aa-bde1-09574be7273d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:50.302234 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa4d7048-8414-46aa-bde1-09574be7273d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:50.302661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa4d7048-8414-46aa-bde1-09574be7273d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:50.303338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa4d7048-8414-46aa-bde1-09574be7273d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:50.303787 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa4d7048-8414-46aa-bde1-09574be7273d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:50.304227 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa4d7048-8414-46aa-bde1-09574be7273d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:50.442359 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fa4d7048-8414-46aa-bde1-09574be7273d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:50.450001 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fa4d7048-8414-46aa-bde1-09574be7273d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.159540 Oct 14 17:57:50.450562 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 178/363] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:50 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:51.026071 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:51.027776 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:51.035413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:51.036328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:51.037009 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:51.038422 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:51.039108 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:51.039603 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:51.177222 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:51.185735 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:51.187732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:51.188924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-366d0f7d-943c-43ea-9d01-cd1aba2bdd44 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.166819 Oct 14 17:57:51.189472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 186/364] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:51 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:51.473306 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c831c3e8-5b57-4f09-aefd-c742dc2892f7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:51.473940 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c831c3e8-5b57-4f09-aefd-c742dc2892f7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:51.480366 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c831c3e8-5b57-4f09-aefd-c742dc2892f7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:51.480839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c831c3e8-5b57-4f09-aefd-c742dc2892f7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:51.481264 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c831c3e8-5b57-4f09-aefd-c742dc2892f7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:51.481939 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c831c3e8-5b57-4f09-aefd-c742dc2892f7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:51.482407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c831c3e8-5b57-4f09-aefd-c742dc2892f7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:51.482820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c831c3e8-5b57-4f09-aefd-c742dc2892f7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:51.629670 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c831c3e8-5b57-4f09-aefd-c742dc2892f7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:51.637408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c831c3e8-5b57-4f09-aefd-c742dc2892f7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.168000 Oct 14 17:57:51.637976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 179/365] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:51 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:52.214508 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:52.215107 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:52.221536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:52.222012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:52.222445 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:52.223123 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:52.223570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:52.224013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:52.474859 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:52.483131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:52.485451 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:52.486727 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-77575a0c-00e4-47c5-a2e1-6fcebb17ac8e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.276147 Oct 14 17:57:52.487400 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 187/366] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:52 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:52.660988 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a8bbf7e9-1bba-4d5b-88de-33dd89abeadc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:52.661587 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a8bbf7e9-1bba-4d5b-88de-33dd89abeadc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:52.673276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a8bbf7e9-1bba-4d5b-88de-33dd89abeadc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:52.673757 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a8bbf7e9-1bba-4d5b-88de-33dd89abeadc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:52.674216 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a8bbf7e9-1bba-4d5b-88de-33dd89abeadc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:52.674908 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a8bbf7e9-1bba-4d5b-88de-33dd89abeadc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:52.675351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a8bbf7e9-1bba-4d5b-88de-33dd89abeadc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:52.675766 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a8bbf7e9-1bba-4d5b-88de-33dd89abeadc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:52.811597 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a8bbf7e9-1bba-4d5b-88de-33dd89abeadc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:52.820891 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a8bbf7e9-1bba-4d5b-88de-33dd89abeadc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.163567 Oct 14 17:57:52.821465 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 180/367] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:52 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:52.946364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-658136d2-2099-40c5-b12f-70bf518fdb2c req-d8f7ddef-fdcd-4315-b3df-ac7bffbe02a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9a8094-ee6e-4a32-96a6-94c18538fd29", "tag": "687bc207-2144-4d90-83f9-83cd2654a936"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:52.956144 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-658136d2-2099-40c5-b12f-70bf518fdb2c req-d8f7ddef-fdcd-4315-b3df-ac7bffbe02a9 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:52.956612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-658136d2-2099-40c5-b12f-70bf518fdb2c req-d8f7ddef-fdcd-4315-b3df-ac7bffbe02a9 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:52.957029 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-658136d2-2099-40c5-b12f-70bf518fdb2c req-d8f7ddef-fdcd-4315-b3df-ac7bffbe02a9 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:52.968659 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-658136d2-2099-40c5-b12f-70bf518fdb2c req-d8f7ddef-fdcd-4315-b3df-ac7bffbe02a9 service nova] Creating event network-changed:687bc207-2144-4d90-83f9-83cd2654a936 for instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 on hv-cinder-74915 Oct 14 17:57:52.973136 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-658136d2-2099-40c5-b12f-70bf518fdb2c req-d8f7ddef-fdcd-4315-b3df-ac7bffbe02a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030493 Oct 14 17:57:52.973737 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 188/368] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:57:53.513393 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:53.513986 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:53.519940 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:53.520412 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:53.520837 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:53.521510 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:53.521947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:53.522357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:53.650188 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:53.658311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:53.659736 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:53.660900 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0d6908d8-6cd9-4dd5-8b5b-ec7c1ed53936 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.151460 Oct 14 17:57:53.661457 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 181/369] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:53 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:53.845226 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-fa465cce-1e80-4f87-bd2d-12170159f312 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:53.845918 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-fa465cce-1e80-4f87-bd2d-12170159f312 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:53.852074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa465cce-1e80-4f87-bd2d-12170159f312 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:53.852550 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa465cce-1e80-4f87-bd2d-12170159f312 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:53.852981 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa465cce-1e80-4f87-bd2d-12170159f312 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:53.853661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa465cce-1e80-4f87-bd2d-12170159f312 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:53.854108 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa465cce-1e80-4f87-bd2d-12170159f312 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:53.854524 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa465cce-1e80-4f87-bd2d-12170159f312 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:53.984575 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-fa465cce-1e80-4f87-bd2d-12170159f312 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:53.992054 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-fa465cce-1e80-4f87-bd2d-12170159f312 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.151355 Oct 14 17:57:53.992612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 189/370] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:53 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:54.686785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:54.687987 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:54.694322 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:54.694808 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:54.695242 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:54.695970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:54.696427 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:54.696851 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:54.932581 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:54.944403 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:54.946347 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:54.947971 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-6d937908-7c98-444b-a8c1-a185260d2939 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1722 microversion: 2.20 time: 0.264863 Oct 14 17:57:54.949120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 182/371] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:54 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:57:55.014865 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-67458bd8-af30-42e0-90b2-de2b06e1387d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:55.016474 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-67458bd8-af30-42e0-90b2-de2b06e1387d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:55.023170 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67458bd8-af30-42e0-90b2-de2b06e1387d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:55.023770 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67458bd8-af30-42e0-90b2-de2b06e1387d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:55.024576 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67458bd8-af30-42e0-90b2-de2b06e1387d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:55.025613 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67458bd8-af30-42e0-90b2-de2b06e1387d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:55.026568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67458bd8-af30-42e0-90b2-de2b06e1387d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:55.027162 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67458bd8-af30-42e0-90b2-de2b06e1387d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:55.170894 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-67458bd8-af30-42e0-90b2-de2b06e1387d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:55.180024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-67458bd8-af30-42e0-90b2-de2b06e1387d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.169381 Oct 14 17:57:55.180578 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 190/372] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:55 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:55.910436 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-90984456-88dc-4db4-b3d7-bd742d4fbe74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:55.911001 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-90984456-88dc-4db4-b3d7-bd742d4fbe74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:55.917450 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90984456-88dc-4db4-b3d7-bd742d4fbe74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:55.917925 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90984456-88dc-4db4-b3d7-bd742d4fbe74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:55.918351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90984456-88dc-4db4-b3d7-bd742d4fbe74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:55.919030 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90984456-88dc-4db4-b3d7-bd742d4fbe74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:55.919474 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90984456-88dc-4db4-b3d7-bd742d4fbe74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:55.919905 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-90984456-88dc-4db4-b3d7-bd742d4fbe74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:55.946269 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-90984456-88dc-4db4-b3d7-bd742d4fbe74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Going to try to terminate instance {{(pid=118656) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 17:57:55.974716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:55.975322 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:55.981342 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:55.981821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:55.982245 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:55.982931 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:55.983379 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:55.984492 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:55.985396 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:56.034899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-90984456-88dc-4db4-b3d7-bd742d4fbe74 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 204 len: 0 microversion: 2.1 time: 0.128629 Oct 14 17:57:56.035510 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 183/373] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 17:57:55 2022] DELETE /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 17:57:56.044229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-21f19478-5763-4bb5-8ca5-e4bf569026b1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:56.045723 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-21f19478-5763-4bb5-8ca5-e4bf569026b1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:56.051684 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-21f19478-5763-4bb5-8ca5-e4bf569026b1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:56.052198 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-21f19478-5763-4bb5-8ca5-e4bf569026b1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:56.052634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-21f19478-5763-4bb5-8ca5-e4bf569026b1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:56.053330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-21f19478-5763-4bb5-8ca5-e4bf569026b1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:56.053783 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-21f19478-5763-4bb5-8ca5-e4bf569026b1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:56.054200 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-21f19478-5763-4bb5-8ca5-e4bf569026b1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:56.150922 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:56.159869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:56.161316 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:56.162453 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5375ee6e-9f24-47d0-8cd7-4f4d2e99cc2f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1665 microversion: 2.20 time: 0.191663 Oct 14 17:57:56.163257 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 191/374] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:55 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1665 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:57:56.188303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-67216758-ba7e-4842-90cd-0e0194806ba7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31b2fbf3-4cd7-4dd7-b01e-d7e5c3b774d8"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:56.190801 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-67216758-ba7e-4842-90cd-0e0194806ba7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:56.196646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67216758-ba7e-4842-90cd-0e0194806ba7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:56.197126 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67216758-ba7e-4842-90cd-0e0194806ba7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:56.197548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67216758-ba7e-4842-90cd-0e0194806ba7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:56.198317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67216758-ba7e-4842-90cd-0e0194806ba7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:56.198769 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67216758-ba7e-4842-90cd-0e0194806ba7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:56.199193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67216758-ba7e-4842-90cd-0e0194806ba7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:56.206664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-21f19478-5763-4bb5-8ca5-e4bf569026b1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:56.214338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-21f19478-5763-4bb5-8ca5-e4bf569026b1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1514 microversion: 2.1 time: 0.174190 Oct 14 17:57:56.214901 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 184/375] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:56 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:56.219685 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-516aa889-5735-4226-afa0-fa1cf76140ba tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:56.220303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-516aa889-5735-4226-afa0-fa1cf76140ba tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:56.225897 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-516aa889-5735-4226-afa0-fa1cf76140ba tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:56.226371 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-516aa889-5735-4226-afa0-fa1cf76140ba tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:56.226798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-516aa889-5735-4226-afa0-fa1cf76140ba tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:56.227546 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-516aa889-5735-4226-afa0-fa1cf76140ba tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:56.228026 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-516aa889-5735-4226-afa0-fa1cf76140ba tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:56.228444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-516aa889-5735-4226-afa0-fa1cf76140ba tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:56.358418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-516aa889-5735-4226-afa0-fa1cf76140ba tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:56.366539 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-516aa889-5735-4226-afa0-fa1cf76140ba tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.150613 Oct 14 17:57:56.367168 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 185/376] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:56 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:56.417948 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:56.501499 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-67216758-ba7e-4842-90cd-0e0194806ba7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "POST /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.317823 Oct 14 17:57:56.502146 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 192/377] 10.222.0.27 () {62 vars in 1364 bytes} [Fri Oct 14 17:57:56 2022] POST /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 17:57:56.625198 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8c2395bd-3213-448f-843b-c301686ba147 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:56.625768 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8c2395bd-3213-448f-843b-c301686ba147 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:56.631858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8c2395bd-3213-448f-843b-c301686ba147 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:56.632372 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8c2395bd-3213-448f-843b-c301686ba147 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:56.632806 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8c2395bd-3213-448f-843b-c301686ba147 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:56.633488 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8c2395bd-3213-448f-843b-c301686ba147 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:56.633938 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8c2395bd-3213-448f-843b-c301686ba147 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:56.634366 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8c2395bd-3213-448f-843b-c301686ba147 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:56.679953 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8c2395bd-3213-448f-843b-c301686ba147 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118656) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 17:57:56.745749 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8c2395bd-3213-448f-843b-c301686ba147 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "POST /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/action" status: 202 len: 0 microversion: 2.20 time: 0.124460 Oct 14 17:57:56.746384 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 186/378] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Oct 14 17:57:56 2022] POST /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 17:57:56.754556 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:56.755160 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:56.763509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:56.764024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:56.764467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:56.765646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:56.766102 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:56.766699 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:56.900002 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:56.908513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:56.909918 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:56.911093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4a94bcdb-f5ff-488f-abfc-6589da3689ba tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1751 microversion: 2.20 time: 0.160410 Oct 14 17:57:56.911631 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 193/379] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:56 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:57.238405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1b1dd1d0-a640-4e64-ab5d-b27f20373d23 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:57.239222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1b1dd1d0-a640-4e64-ab5d-b27f20373d23 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:57.245136 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b1dd1d0-a640-4e64-ab5d-b27f20373d23 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:57.245614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b1dd1d0-a640-4e64-ab5d-b27f20373d23 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:57.246044 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b1dd1d0-a640-4e64-ab5d-b27f20373d23 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:57.246725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b1dd1d0-a640-4e64-ab5d-b27f20373d23 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:57.247184 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b1dd1d0-a640-4e64-ab5d-b27f20373d23 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:57.247583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b1dd1d0-a640-4e64-ab5d-b27f20373d23 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:57.398368 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8fffdcd6-0c2f-4f43-a628-1de5fd5676eb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:57.399076 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8fffdcd6-0c2f-4f43-a628-1de5fd5676eb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:57.405271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8fffdcd6-0c2f-4f43-a628-1de5fd5676eb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:57.405807 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8fffdcd6-0c2f-4f43-a628-1de5fd5676eb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:57.406247 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8fffdcd6-0c2f-4f43-a628-1de5fd5676eb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:57.406945 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8fffdcd6-0c2f-4f43-a628-1de5fd5676eb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:57.407398 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8fffdcd6-0c2f-4f43-a628-1de5fd5676eb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:57.407821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8fffdcd6-0c2f-4f43-a628-1de5fd5676eb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:57.419031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1b1dd1d0-a640-4e64-ab5d-b27f20373d23 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:57.427190 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1b1dd1d0-a640-4e64-ab5d-b27f20373d23 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1514 microversion: 2.1 time: 0.193131 Oct 14 17:57:57.427690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 187/380] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:57 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:57.544414 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8fffdcd6-0c2f-4f43-a628-1de5fd5676eb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:57.552548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8fffdcd6-0c2f-4f43-a628-1de5fd5676eb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.165879 Oct 14 17:57:57.553115 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 194/381] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:57 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:57:57.937615 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:57.938210 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:57.944152 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:57.944623 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:57.945084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:57.945777 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:57.946229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:57.946651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:58.070953 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:58.079305 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:58.080912 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:58.082056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-815bab6b-c5c3-4ead-a976-c50bb3db6123 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1751 microversion: 2.20 time: 0.148525 Oct 14 17:57:58.082610 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 188/382] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:57 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:58.450690 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2bcd7e7d-74bf-43a3-9400-67f61418d7d0 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:58.451181 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2bcd7e7d-74bf-43a3-9400-67f61418d7d0 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:58.457939 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2bcd7e7d-74bf-43a3-9400-67f61418d7d0 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:58.458417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2bcd7e7d-74bf-43a3-9400-67f61418d7d0 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:58.458843 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2bcd7e7d-74bf-43a3-9400-67f61418d7d0 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:58.459556 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2bcd7e7d-74bf-43a3-9400-67f61418d7d0 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:58.460074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2bcd7e7d-74bf-43a3-9400-67f61418d7d0 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:58.460494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2bcd7e7d-74bf-43a3-9400-67f61418d7d0 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:58.576329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-59f6ba40-fb5b-4bb2-96be-e58af5897df2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:58.577559 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-59f6ba40-fb5b-4bb2-96be-e58af5897df2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:58.585923 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59f6ba40-fb5b-4bb2-96be-e58af5897df2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:58.586634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59f6ba40-fb5b-4bb2-96be-e58af5897df2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:58.587235 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59f6ba40-fb5b-4bb2-96be-e58af5897df2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:58.588111 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59f6ba40-fb5b-4bb2-96be-e58af5897df2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:58.588706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59f6ba40-fb5b-4bb2-96be-e58af5897df2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:58.589396 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59f6ba40-fb5b-4bb2-96be-e58af5897df2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:58.602314 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2bcd7e7d-74bf-43a3-9400-67f61418d7d0 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:58.614493 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2bcd7e7d-74bf-43a3-9400-67f61418d7d0 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1514 microversion: 2.1 time: 0.167743 Oct 14 17:57:58.615177 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 195/383] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:58 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:58.732025 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-59f6ba40-fb5b-4bb2-96be-e58af5897df2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:58.740293 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-59f6ba40-fb5b-4bb2-96be-e58af5897df2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.167608 Oct 14 17:57:58.741069 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 189/384] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:58 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:59.108131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:59.108856 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:59.117027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:59.117926 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:59.118620 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:59.119521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:59.119998 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:59.120638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:59.172993 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-a72a5872-1f4b-478c-a0da-58b7b4863be9 req-a058de76-abb0-4aff-9aa6-9b5710405f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540e714d-90e7-4e09-b976-07d53f7a8444", "name": "network-vif-deleted", "tag": "a586fa77-4dad-4db8-be6a-9bbf0c9aa156"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:57:59.182893 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-a72a5872-1f4b-478c-a0da-58b7b4863be9 req-a058de76-abb0-4aff-9aa6-9b5710405f36 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:59.183726 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-a72a5872-1f4b-478c-a0da-58b7b4863be9 req-a058de76-abb0-4aff-9aa6-9b5710405f36 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:59.184325 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-a72a5872-1f4b-478c-a0da-58b7b4863be9 req-a058de76-abb0-4aff-9aa6-9b5710405f36 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:59.197189 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-a72a5872-1f4b-478c-a0da-58b7b4863be9 req-a058de76-abb0-4aff-9aa6-9b5710405f36 service nova] Creating event network-vif-deleted:a586fa77-4dad-4db8-be6a-9bbf0c9aa156 for instance 540e714d-90e7-4e09-b976-07d53f7a8444 on hv-cinder-74915 Oct 14 17:57:59.202327 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-a72a5872-1f4b-478c-a0da-58b7b4863be9 req-a058de76-abb0-4aff-9aa6-9b5710405f36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033853 Oct 14 17:57:59.206318 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 190/385] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 17:57:59.280259 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:59.290137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:59.292037 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:59.293382 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-759dc8b8-c1d6-4871-8e85-761426afaffb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1753 microversion: 2.20 time: 0.189242 Oct 14 17:57:59.295910 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 196/386] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:57:59 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:57:59.639572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:59.640211 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:59.646269 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:59.646740 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:59.647169 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:59.647844 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:59.648313 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:59.648730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:59.679844 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:59.680349 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:59.680785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:59.681227 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lazy-loading 'fault' on Instance uuid 540e714d-90e7-4e09-b976-07d53f7a8444 {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:57:59.725569 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:59.733083 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c32a821e-17a5-4976-840f-7e2c02b8d86d tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 200 len: 1309 microversion: 2.1 time: 0.098169 Oct 14 17:57:59.733648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 191/387] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:59 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:57:59.763728 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5707f830-fe9c-4ff5-9865-0c11ee843922 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:57:59.764610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5707f830-fe9c-4ff5-9865-0c11ee843922 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:57:59.771023 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5707f830-fe9c-4ff5-9865-0c11ee843922 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:59.771501 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5707f830-fe9c-4ff5-9865-0c11ee843922 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:59.771987 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5707f830-fe9c-4ff5-9865-0c11ee843922 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:59.772680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5707f830-fe9c-4ff5-9865-0c11ee843922 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:57:59.773132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5707f830-fe9c-4ff5-9865-0c11ee843922 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:57:59.773548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5707f830-fe9c-4ff5-9865-0c11ee843922 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:57:59.910603 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5707f830-fe9c-4ff5-9865-0c11ee843922 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:57:59.919070 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5707f830-fe9c-4ff5-9865-0c11ee843922 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.158969 Oct 14 17:57:59.935456 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 197/388] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:57:59 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:00.326395 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:00.327043 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:00.333242 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:00.333723 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:00.334153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:00.334839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:00.335291 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:00.335708 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:00.485227 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:00.494955 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:00.496411 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:00.497785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e0872983-f034-42f5-a670-74395620ad04 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.175265 Oct 14 17:58:00.498863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 192/389] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:00 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:00.756562 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:00.757171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 540e714d-90e7-4e09-b976-07d53f7a8444] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:00.762923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:00.763404 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:00.763838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:00.764564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:00.765021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:00.765966 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:00.779602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] HTTP exception thrown: Instance 540e714d-90e7-4e09-b976-07d53f7a8444 could not be found. Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Request method failure captured: Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 HTTP/1.1 Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaLjWKbjP-Uch4Z6pZIXws-BYSiEsBvw02Jk9-D8XW6x88oYdJ6eVUa-CHJqODQ5hm2tmdAReSVmNqMDqLI_n0lRPM_nDHvlF574pf4tjWU8Oek8IaV4OiKc42cXJc-HGYaWXL4leEoXEUfOCw0IqF5qxQd0-gIWrDlvssbW4SbKQ6U Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 19f786f7363e44d78e478f2fec202f4d Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-VolumesSnapshotTestJSON-334156454 Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 17:58:00.782155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19f786f7363e44d78e478f2fec202f4d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f786f7363e44d78e478f2fec202f4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19f786f7363e44d78e478f2fec202f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f786f7363e44d78e478f2fec202f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-VolumesSnapshotTestJSON-334156454 Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 19f786f7363e44d78e478f2fec202f4d Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-334156454 Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-VolumesSnapshotTestJSON-334156454-project Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 1a23bceab9e14ee8907eef2a2df85799 Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-VolumesSnapshotTestJSON-334156454-project Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 540e714d-90e7-4e09-b976-07d53f7a8444 could not be found. Oct 14 17:58:00.783742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '540e714d-90e7-4e09-b976-07d53f7a8444'} Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540e714d-90e7-4e09-b976-07d53f7a8444 could not be found. Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:58:00.788795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540e714d-90e7-4e09-b976-07d53f7a8444 could not be found. Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540e714d-90e7-4e09-b976-07d53f7a8444 could not be found. Oct 14 17:58:00.790238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:58:00.791509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Returning 404 to user: Instance 540e714d-90e7-4e09-b976-07d53f7a8444 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:58:00.791509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4bb1315d-11b0-4c1f-a49d-68a32b8b4f7a tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444" status: 404 len: 111 microversion: 2.1 time: 0.030977 Oct 14 17:58:00.791509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 198/390] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:00 2022] GET /compute/v2.1/servers/540e714d-90e7-4e09-b976-07d53f7a8444 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 17:58:00.944205 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bebc7b04-c747-4aba-b267-49d753e968a7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:00.944860 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-bebc7b04-c747-4aba-b267-49d753e968a7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:00.950878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bebc7b04-c747-4aba-b267-49d753e968a7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:00.951577 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bebc7b04-c747-4aba-b267-49d753e968a7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:00.952200 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bebc7b04-c747-4aba-b267-49d753e968a7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:00.954257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bebc7b04-c747-4aba-b267-49d753e968a7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:00.954903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bebc7b04-c747-4aba-b267-49d753e968a7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:00.955491 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bebc7b04-c747-4aba-b267-49d753e968a7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:01.044868 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-7b07c772-b5d4-407e-b8e2-d27ad752b4da req-733c3c2c-19af-4450-9b46-d5efd53d368e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9a8094-ee6e-4a32-96a6-94c18538fd29", "name": "network-vif-plugged", "status": "completed", "tag": "687bc207-2144-4d90-83f9-83cd2654a936"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:01.055375 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-7b07c772-b5d4-407e-b8e2-d27ad752b4da req-733c3c2c-19af-4450-9b46-d5efd53d368e service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:01.056229 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-7b07c772-b5d4-407e-b8e2-d27ad752b4da req-733c3c2c-19af-4450-9b46-d5efd53d368e service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:01.056517 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-7b07c772-b5d4-407e-b8e2-d27ad752b4da req-733c3c2c-19af-4450-9b46-d5efd53d368e service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:01.071452 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-7b07c772-b5d4-407e-b8e2-d27ad752b4da req-733c3c2c-19af-4450-9b46-d5efd53d368e service nova] Creating event network-vif-plugged:687bc207-2144-4d90-83f9-83cd2654a936 for instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 on hv-cinder-74915 Oct 14 17:58:01.076739 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-7b07c772-b5d4-407e-b8e2-d27ad752b4da req-733c3c2c-19af-4450-9b46-d5efd53d368e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035697 Oct 14 17:58:01.078625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 199/391] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 17:58:01.111130 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-bebc7b04-c747-4aba-b267-49d753e968a7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:01.120877 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-bebc7b04-c747-4aba-b267-49d753e968a7 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.180200 Oct 14 17:58:01.121916 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 193/392] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:00 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:01.525177 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:01.525778 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:01.532386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:01.532859 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:01.533296 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:01.533997 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:01.534441 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:01.534857 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:01.668721 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:01.677402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:01.678822 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:01.679981 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-75ff8592-f09d-477c-928c-4104ed51ad19 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.159258 Oct 14 17:58:01.680533 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 200/393] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:01 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:02.145586 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bad313b6-f69d-4045-8a83-74ce36a7c39a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:02.146189 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-bad313b6-f69d-4045-8a83-74ce36a7c39a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:02.148606 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:02.153856 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bad313b6-f69d-4045-8a83-74ce36a7c39a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:02.154332 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bad313b6-f69d-4045-8a83-74ce36a7c39a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:02.154755 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bad313b6-f69d-4045-8a83-74ce36a7c39a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:02.155427 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bad313b6-f69d-4045-8a83-74ce36a7c39a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:02.155912 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bad313b6-f69d-4045-8a83-74ce36a7c39a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:02.156509 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bad313b6-f69d-4045-8a83-74ce36a7c39a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:02.282909 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-bad313b6-f69d-4045-8a83-74ce36a7c39a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:02.290815 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-bad313b6-f69d-4045-8a83-74ce36a7c39a tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.148980 Oct 14 17:58:02.291375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 194/394] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:02 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:02.708787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:02.709378 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:02.711349 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:02.717160 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:02.717642 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:02.718075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:02.719422 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:02.719832 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:02.720299 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:02.846795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:02.855486 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:02.856971 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:02.858120 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-60af5ede-85db-4e46-93f3-04c12a6b9575 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.153271 Oct 14 17:58:02.858674 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 201/395] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:02 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:03.314552 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e7b648d1-9a0d-4d53-949a-d4776067a6f9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:03.315234 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e7b648d1-9a0d-4d53-949a-d4776067a6f9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:03.322020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b648d1-9a0d-4d53-949a-d4776067a6f9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:03.322443 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b648d1-9a0d-4d53-949a-d4776067a6f9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:03.322922 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b648d1-9a0d-4d53-949a-d4776067a6f9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:03.323846 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b648d1-9a0d-4d53-949a-d4776067a6f9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:03.324510 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b648d1-9a0d-4d53-949a-d4776067a6f9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:03.340915 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b648d1-9a0d-4d53-949a-d4776067a6f9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:03.493979 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e7b648d1-9a0d-4d53-949a-d4776067a6f9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:03.503282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e7b648d1-9a0d-4d53-949a-d4776067a6f9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.193049 Oct 14 17:58:03.514626 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 195/396] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:03 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:03.884089 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:03.884734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:03.891001 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:03.891481 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:03.891933 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:03.892624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:03.893077 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:03.893501 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:04.034031 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:04.042790 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:04.044261 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:04.045414 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-52008874-807e-4610-888f-c5fcd4b611a0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.165251 Oct 14 17:58:04.045968 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 202/397] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:03 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:04.527589 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-26a399cd-e578-4c7b-923a-a735452eaab2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:04.528233 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-26a399cd-e578-4c7b-923a-a735452eaab2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:04.535476 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-26a399cd-e578-4c7b-923a-a735452eaab2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:04.535988 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-26a399cd-e578-4c7b-923a-a735452eaab2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:04.536422 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-26a399cd-e578-4c7b-923a-a735452eaab2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:04.537139 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-26a399cd-e578-4c7b-923a-a735452eaab2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:04.537588 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-26a399cd-e578-4c7b-923a-a735452eaab2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:04.538003 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-26a399cd-e578-4c7b-923a-a735452eaab2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:04.688586 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-26a399cd-e578-4c7b-923a-a735452eaab2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:04.696673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-26a399cd-e578-4c7b-923a-a735452eaab2 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.172930 Oct 14 17:58:04.697496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 196/398] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:04 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:05.071716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:05.072497 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:05.079755 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:05.080278 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:05.080711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:05.081405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:05.081849 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:05.082258 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:05.236596 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:05.246584 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:05.248097 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:05.249264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ac57b4ab-bb2a-430f-a8dc-bc35a4106d97 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.181502 Oct 14 17:58:05.250539 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 203/399] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:05 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:05.720303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0b68d22d-b887-43ab-8ee0-6f11f54e3504 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:05.720927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0b68d22d-b887-43ab-8ee0-6f11f54e3504 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:05.727251 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b68d22d-b887-43ab-8ee0-6f11f54e3504 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:05.727728 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b68d22d-b887-43ab-8ee0-6f11f54e3504 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:05.728197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b68d22d-b887-43ab-8ee0-6f11f54e3504 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:05.728885 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b68d22d-b887-43ab-8ee0-6f11f54e3504 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:05.729334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b68d22d-b887-43ab-8ee0-6f11f54e3504 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:05.729754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0b68d22d-b887-43ab-8ee0-6f11f54e3504 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:05.867084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0b68d22d-b887-43ab-8ee0-6f11f54e3504 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:05.876706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0b68d22d-b887-43ab-8ee0-6f11f54e3504 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.159514 Oct 14 17:58:05.877304 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 197/400] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:05 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:06.279035 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:06.279785 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:06.286478 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:06.286966 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:06.287402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:06.288400 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:06.288862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:06.289287 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:06.440298 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:06.449172 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:06.450621 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:06.451866 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-97ad2d16-0c90-475e-9a39-a85635318efe tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.176814 Oct 14 17:58:06.452457 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 204/401] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:06 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:06.899782 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bd097db5-804f-4d52-97fa-9cc6ad060665 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:06.900490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-bd097db5-804f-4d52-97fa-9cc6ad060665 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:06.908255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd097db5-804f-4d52-97fa-9cc6ad060665 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:06.909118 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd097db5-804f-4d52-97fa-9cc6ad060665 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:06.909797 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd097db5-804f-4d52-97fa-9cc6ad060665 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:06.910730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd097db5-804f-4d52-97fa-9cc6ad060665 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:06.911389 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd097db5-804f-4d52-97fa-9cc6ad060665 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:06.912047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bd097db5-804f-4d52-97fa-9cc6ad060665 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:07.042375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-bd097db5-804f-4d52-97fa-9cc6ad060665 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:07.050900 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-bd097db5-804f-4d52-97fa-9cc6ad060665 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.154846 Oct 14 17:58:07.051481 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 198/402] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:06 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:07.479624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:07.480263 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:07.486421 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:07.486895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:07.487322 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:07.488046 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:07.488491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:07.488909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:07.634647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:07.643850 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:07.645336 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:07.646649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a0ddc7e9-4b6c-41a8-a580-0f797e296d30 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.171100 Oct 14 17:58:07.647370 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 205/403] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:07 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:08.074013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7814f075-d93e-410a-9e87-20a51ac01525 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:08.074775 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7814f075-d93e-410a-9e87-20a51ac01525 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:08.081081 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7814f075-d93e-410a-9e87-20a51ac01525 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:08.081553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7814f075-d93e-410a-9e87-20a51ac01525 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:08.081978 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7814f075-d93e-410a-9e87-20a51ac01525 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:08.082659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7814f075-d93e-410a-9e87-20a51ac01525 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:08.083104 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7814f075-d93e-410a-9e87-20a51ac01525 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:08.083518 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7814f075-d93e-410a-9e87-20a51ac01525 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:08.087375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:08.226536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7814f075-d93e-410a-9e87-20a51ac01525 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:08.234124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7814f075-d93e-410a-9e87-20a51ac01525 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.163955 Oct 14 17:58:08.235213 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 199/404] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:08 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:08.672981 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:08.673591 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:08.679605 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:08.680120 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:08.680670 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:08.681362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:08.681813 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:08.682392 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:08.827181 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:08.836304 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:08.837728 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:08.839067 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ddf8277e-db87-466c-8890-9ed5116fb079 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.170730 Oct 14 17:58:08.839617 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 206/405] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:08 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:09.257566 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ed8a3d21-e3ac-4315-9d33-9cf44b397661 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:09.258279 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ed8a3d21-e3ac-4315-9d33-9cf44b397661 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:09.265107 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed8a3d21-e3ac-4315-9d33-9cf44b397661 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:09.265696 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed8a3d21-e3ac-4315-9d33-9cf44b397661 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:09.266930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed8a3d21-e3ac-4315-9d33-9cf44b397661 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:09.267646 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed8a3d21-e3ac-4315-9d33-9cf44b397661 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:09.268191 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed8a3d21-e3ac-4315-9d33-9cf44b397661 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:09.268811 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed8a3d21-e3ac-4315-9d33-9cf44b397661 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:09.399503 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ed8a3d21-e3ac-4315-9d33-9cf44b397661 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:09.407126 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ed8a3d21-e3ac-4315-9d33-9cf44b397661 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.153377 Oct 14 17:58:09.407689 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 200/406] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:09 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:09.865475 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:09.866111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:09.871985 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:09.872459 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:09.872881 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:09.873555 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:09.873997 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:09.874409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:10.000742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:10.009186 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:10.010617 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:10.011755 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-76422db6-38a8-4711-939e-2f02be25a529 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.150227 Oct 14 17:58:10.012350 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 207/407] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:09 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:10.430152 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e7e05366-d37c-4b9d-bd77-5fb884341538 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:10.430753 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e7e05366-d37c-4b9d-bd77-5fb884341538 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:10.437126 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7e05366-d37c-4b9d-bd77-5fb884341538 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:10.437616 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7e05366-d37c-4b9d-bd77-5fb884341538 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:10.438640 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7e05366-d37c-4b9d-bd77-5fb884341538 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:10.439300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7e05366-d37c-4b9d-bd77-5fb884341538 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:10.439749 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7e05366-d37c-4b9d-bd77-5fb884341538 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:10.440199 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7e05366-d37c-4b9d-bd77-5fb884341538 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:10.569585 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e7e05366-d37c-4b9d-bd77-5fb884341538 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:10.577244 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e7e05366-d37c-4b9d-bd77-5fb884341538 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.150927 Oct 14 17:58:10.577805 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 201/408] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:10 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:10.861823 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1020011634", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "networks": [{"uuid": "0839c4a7-60df-4004-b766-c9b4558a0a2e"}]}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:10.924148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] validate_networks() for [('0839c4a7-60df-4004-b766-c9b4558a0a2e', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:58:11.037208 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:11.037808 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:11.044104 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:11.044589 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:11.045019 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:11.045708 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:11.046159 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:11.046577 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:11.340478 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:11.357610 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:11.360958 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:11.362282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2a2fa91f-0cb8-473b-94bb-064bfb7760a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.328955 Oct 14 17:58:11.362956 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 202/409] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:11 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:58:11.401708 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:58:11.402122 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:58:11.402715 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:58:11.403154 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:58:11.403522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:58:11.414417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:11.414923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:11.415310 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:11.416050 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:11.417059 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:11.417650 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:11.445921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Getting quotas for project 19f786f7363e44d78e478f2fec202f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:58:11.445921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Getting quotas for user 1a23bceab9e14ee8907eef2a2df85799 and project 19f786f7363e44d78e478f2fec202f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:58:11.453198 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:58:11.455727 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:58:11.503432 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c0434073-54df-4731-9361-738d8f99d1b8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646700 Oct 14 17:58:11.510057 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 208/410] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 17:58:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 17:58:11.516444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3d94efe2-2a8e-40d0-8dda-dd8daa1b84c4 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:11.517631 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3d94efe2-2a8e-40d0-8dda-dd8daa1b84c4 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:11.577148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3d94efe2-2a8e-40d0-8dda-dd8daa1b84c4 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:11.586811 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3d94efe2-2a8e-40d0-8dda-dd8daa1b84c4 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1219 microversion: 2.1 time: 0.075064 Oct 14 17:58:11.588147 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 203/411] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:11 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:11.605321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a53821f5-7e15-48f4-9d09-7b235990329c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:11.606204 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a53821f5-7e15-48f4-9d09-7b235990329c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:11.614271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a53821f5-7e15-48f4-9d09-7b235990329c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:11.615272 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a53821f5-7e15-48f4-9d09-7b235990329c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:11.615897 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a53821f5-7e15-48f4-9d09-7b235990329c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:11.616772 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a53821f5-7e15-48f4-9d09-7b235990329c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:11.617379 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a53821f5-7e15-48f4-9d09-7b235990329c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:11.617956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a53821f5-7e15-48f4-9d09-7b235990329c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:11.779206 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a53821f5-7e15-48f4-9d09-7b235990329c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:11.788246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a53821f5-7e15-48f4-9d09-7b235990329c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.186818 Oct 14 17:58:11.789311 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 209/412] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:11 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:12.387907 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:12.388468 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:12.395564 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:12.396189 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:12.396625 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:12.397329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:12.397784 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:12.398208 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:12.532022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:12.540753 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:12.542207 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:12.543361 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e0f0e505-e420-42fe-a9b4-a2ed7867b868 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.159430 Oct 14 17:58:12.543934 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 204/413] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:12 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:12.615242 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-def41cc5-1533-4aaa-87c8-cf394f439fb1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:12.615842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-def41cc5-1533-4aaa-87c8-cf394f439fb1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:12.621686 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-def41cc5-1533-4aaa-87c8-cf394f439fb1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:12.622158 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-def41cc5-1533-4aaa-87c8-cf394f439fb1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:12.622579 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-def41cc5-1533-4aaa-87c8-cf394f439fb1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:12.623250 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-def41cc5-1533-4aaa-87c8-cf394f439fb1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:12.623690 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-def41cc5-1533-4aaa-87c8-cf394f439fb1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:12.624128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-def41cc5-1533-4aaa-87c8-cf394f439fb1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:12.641825 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:12.685910 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-def41cc5-1533-4aaa-87c8-cf394f439fb1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:12.694060 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-def41cc5-1533-4aaa-87c8-cf394f439fb1 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1223 microversion: 2.1 time: 0.082628 Oct 14 17:58:12.694616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 210/414] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:12 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:12.812449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-096b1fc4-74c0-4f7e-a1e1-53c5b222b26d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:12.813687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-096b1fc4-74c0-4f7e-a1e1-53c5b222b26d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:12.819520 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-096b1fc4-74c0-4f7e-a1e1-53c5b222b26d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:12.820032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-096b1fc4-74c0-4f7e-a1e1-53c5b222b26d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:12.820460 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-096b1fc4-74c0-4f7e-a1e1-53c5b222b26d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:12.821134 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-096b1fc4-74c0-4f7e-a1e1-53c5b222b26d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:12.821578 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-096b1fc4-74c0-4f7e-a1e1-53c5b222b26d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:12.821989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-096b1fc4-74c0-4f7e-a1e1-53c5b222b26d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:12.954138 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-096b1fc4-74c0-4f7e-a1e1-53c5b222b26d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:12.961816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-096b1fc4-74c0-4f7e-a1e1-53c5b222b26d tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.153074 Oct 14 17:58:12.962373 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 205/415] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:12 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:13.570060 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:13.570656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:13.576580 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:13.577054 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:13.577480 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:13.578155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:13.579185 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:13.579598 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:13.713716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:13.716540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-80416781-7524-40d0-a271-6871e72b8abf tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:13.717155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-80416781-7524-40d0-a271-6871e72b8abf tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:13.723753 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80416781-7524-40d0-a271-6871e72b8abf tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:13.723951 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:13.724271 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80416781-7524-40d0-a271-6871e72b8abf tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:13.724702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80416781-7524-40d0-a271-6871e72b8abf tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:13.725330 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:13.725489 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80416781-7524-40d0-a271-6871e72b8abf tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:13.725838 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80416781-7524-40d0-a271-6871e72b8abf tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:13.726257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80416781-7524-40d0-a271-6871e72b8abf tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:13.727300 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8ef9a57d-c583-4736-848d-5b6676c7e1b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.161178 Oct 14 17:58:13.728115 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 211/416] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:13 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:13.792621 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-80416781-7524-40d0-a271-6871e72b8abf tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:13.801258 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-80416781-7524-40d0-a271-6871e72b8abf tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1215 microversion: 2.1 time: 0.089234 Oct 14 17:58:13.801829 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 206/417] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:13 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:58:13.985923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-92b85ea4-18ef-4e3b-a73b-297187f38b14 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:13.986461 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-92b85ea4-18ef-4e3b-a73b-297187f38b14 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:13.992318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92b85ea4-18ef-4e3b-a73b-297187f38b14 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:13.992787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92b85ea4-18ef-4e3b-a73b-297187f38b14 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:13.993208 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92b85ea4-18ef-4e3b-a73b-297187f38b14 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:13.993881 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92b85ea4-18ef-4e3b-a73b-297187f38b14 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:13.994324 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92b85ea4-18ef-4e3b-a73b-297187f38b14 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:13.994734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-92b85ea4-18ef-4e3b-a73b-297187f38b14 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:14.120540 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-92b85ea4-18ef-4e3b-a73b-297187f38b14 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:14.129565 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-92b85ea4-18ef-4e3b-a73b-297187f38b14 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.148079 Oct 14 17:58:14.130142 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 212/418] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:13 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:14.753281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:14.753884 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:14.760480 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:14.761020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:14.761452 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:14.762170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:14.762618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:14.763038 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:14.825438 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9c0bd7bd-bc4c-477a-8a56-405b0a5b17ab tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:14.826043 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9c0bd7bd-bc4c-477a-8a56-405b0a5b17ab tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:14.832521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c0bd7bd-bc4c-477a-8a56-405b0a5b17ab tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:14.833005 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c0bd7bd-bc4c-477a-8a56-405b0a5b17ab tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:14.833436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c0bd7bd-bc4c-477a-8a56-405b0a5b17ab tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:14.834209 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c0bd7bd-bc4c-477a-8a56-405b0a5b17ab tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:14.834799 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c0bd7bd-bc4c-477a-8a56-405b0a5b17ab tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:14.835294 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c0bd7bd-bc4c-477a-8a56-405b0a5b17ab tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:14.918363 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9c0bd7bd-bc4c-477a-8a56-405b0a5b17ab tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:14.928189 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9c0bd7bd-bc4c-477a-8a56-405b0a5b17ab tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1271 microversion: 2.1 time: 0.106392 Oct 14 17:58:14.928824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 213/419] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:14 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:58:14.936634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:14.946419 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:14.947867 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:14.949379 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-80d2c91a-8c4f-4d27-acba-481f41055784 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.200492 Oct 14 17:58:14.949949 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 207/420] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:14 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:15.153858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4c0b1fa6-0bb4-4936-869a-4bb8c116ecbf tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:15.154879 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4c0b1fa6-0bb4-4936-869a-4bb8c116ecbf tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:15.162200 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c0b1fa6-0bb4-4936-869a-4bb8c116ecbf tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:15.162688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c0b1fa6-0bb4-4936-869a-4bb8c116ecbf tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:15.163437 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c0b1fa6-0bb4-4936-869a-4bb8c116ecbf tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:15.164581 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c0b1fa6-0bb4-4936-869a-4bb8c116ecbf tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:15.165037 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c0b1fa6-0bb4-4936-869a-4bb8c116ecbf tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:15.166108 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c0b1fa6-0bb4-4936-869a-4bb8c116ecbf tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:15.311652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4c0b1fa6-0bb4-4936-869a-4bb8c116ecbf tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:15.320038 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4c0b1fa6-0bb4-4936-869a-4bb8c116ecbf tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1358 microversion: 2.1 time: 0.170912 Oct 14 17:58:15.320601 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 214/421] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:15 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:15.951741 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bdfadb48-4fba-4b63-80e9-7cee7f34053c tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:15.952831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-bdfadb48-4fba-4b63-80e9-7cee7f34053c tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:15.959693 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bdfadb48-4fba-4b63-80e9-7cee7f34053c tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:15.965141 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bdfadb48-4fba-4b63-80e9-7cee7f34053c tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:15.968633 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bdfadb48-4fba-4b63-80e9-7cee7f34053c tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:15.970798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bdfadb48-4fba-4b63-80e9-7cee7f34053c tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:15.970925 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bdfadb48-4fba-4b63-80e9-7cee7f34053c tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:15.971422 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bdfadb48-4fba-4b63-80e9-7cee7f34053c tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:15.984481 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:15.988118 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:15.995918 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:15.998053 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:16.000231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:16.001218 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:16.006587 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:16.007134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:16.114383 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-bdfadb48-4fba-4b63-80e9-7cee7f34053c tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:16.123432 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-bdfadb48-4fba-4b63-80e9-7cee7f34053c tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1289 microversion: 2.1 time: 0.174808 Oct 14 17:58:16.124352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 208/422] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:15 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1289 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:16.189892 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:16.205468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:16.206906 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:16.208104 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c7207e80-1a34-4dda-91f2-b47fdffbb9ee tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.227856 Oct 14 17:58:16.208652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 215/423] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:15 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:58:16.343561 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-049ab788-7b08-4b8d-aa20-c31f73c7c7bc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:16.344894 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-049ab788-7b08-4b8d-aa20-c31f73c7c7bc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:16.351072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-049ab788-7b08-4b8d-aa20-c31f73c7c7bc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:16.351867 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-049ab788-7b08-4b8d-aa20-c31f73c7c7bc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:16.352206 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-049ab788-7b08-4b8d-aa20-c31f73c7c7bc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:16.353076 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-049ab788-7b08-4b8d-aa20-c31f73c7c7bc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:16.353739 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-049ab788-7b08-4b8d-aa20-c31f73c7c7bc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:16.354162 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-049ab788-7b08-4b8d-aa20-c31f73c7c7bc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:16.485448 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-049ab788-7b08-4b8d-aa20-c31f73c7c7bc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:16.493178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-049ab788-7b08-4b8d-aa20-c31f73c7c7bc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1547 microversion: 2.1 time: 0.154098 Oct 14 17:58:16.493754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 209/424] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:16 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:16.515521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-747fc285-b0c9-40b5-9cd7-9ed95d728f66 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:16.517012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-747fc285-b0c9-40b5-9cd7-9ed95d728f66 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:16.523493 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-747fc285-b0c9-40b5-9cd7-9ed95d728f66 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:16.524027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-747fc285-b0c9-40b5-9cd7-9ed95d728f66 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:16.524484 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-747fc285-b0c9-40b5-9cd7-9ed95d728f66 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:16.525293 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-747fc285-b0c9-40b5-9cd7-9ed95d728f66 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:16.525750 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-747fc285-b0c9-40b5-9cd7-9ed95d728f66 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:16.526517 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-747fc285-b0c9-40b5-9cd7-9ed95d728f66 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:16.667202 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-747fc285-b0c9-40b5-9cd7-9ed95d728f66 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:16.676279 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-747fc285-b0c9-40b5-9cd7-9ed95d728f66 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1547 microversion: 2.1 time: 0.164680 Oct 14 17:58:16.686973 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 216/425] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:16 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:16.698992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:16.704986 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:16.706132 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Searching by: {'deleted': False, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28'} {{(pid=118656) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 14 17:58:16.713572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:16.714061 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:16.714487 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:16.715224 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:16.715903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:16.716352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:16.810341 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.multi_cell_list [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118656) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 14 17:58:16.906459 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1293b29f-b99d-4ac1-b538-09d0360fadc9 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211044 Oct 14 17:58:16.908117 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 210/426] 10.222.0.27 () {58 vars in 1125 bytes} [Fri Oct 14 17:58:16 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:58:16.919990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9991dc7e-e2da-44b7-834f-86b85db79ec5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:16.920588 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9991dc7e-e2da-44b7-834f-86b85db79ec5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:16.927576 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9991dc7e-e2da-44b7-834f-86b85db79ec5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:16.928114 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9991dc7e-e2da-44b7-834f-86b85db79ec5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:16.928553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9991dc7e-e2da-44b7-834f-86b85db79ec5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:16.929283 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9991dc7e-e2da-44b7-834f-86b85db79ec5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:16.929738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9991dc7e-e2da-44b7-834f-86b85db79ec5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:16.930159 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9991dc7e-e2da-44b7-834f-86b85db79ec5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:17.060172 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9991dc7e-e2da-44b7-834f-86b85db79ec5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:17.068752 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9991dc7e-e2da-44b7-834f-86b85db79ec5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1547 microversion: 2.1 time: 0.152487 Oct 14 17:58:17.069633 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 217/427] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:16 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:17.147835 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fbbb60c4-af48-4a0c-a025-ef667d35fb24 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:17.148931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fbbb60c4-af48-4a0c-a025-ef667d35fb24 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:17.154952 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fbbb60c4-af48-4a0c-a025-ef667d35fb24 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:17.155577 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fbbb60c4-af48-4a0c-a025-ef667d35fb24 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:17.156144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fbbb60c4-af48-4a0c-a025-ef667d35fb24 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:17.156947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fbbb60c4-af48-4a0c-a025-ef667d35fb24 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:17.158193 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fbbb60c4-af48-4a0c-a025-ef667d35fb24 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:17.158681 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fbbb60c4-af48-4a0c-a025-ef667d35fb24 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:17.236329 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-9cf85f07-6718-4cd3-8f37-12e21e717f39 req-f9475ff8-18df-42e3-877a-c832276ebb43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188c63cc-0d29-43b4-b4c9-c42631a8c6d7", "tag": "613f87b0-b830-4be7-b6f3-9f48ace26266"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:17.247115 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-9cf85f07-6718-4cd3-8f37-12e21e717f39 req-f9475ff8-18df-42e3-877a-c832276ebb43 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:17.247763 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-9cf85f07-6718-4cd3-8f37-12e21e717f39 req-f9475ff8-18df-42e3-877a-c832276ebb43 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:17.248213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-9cf85f07-6718-4cd3-8f37-12e21e717f39 req-f9475ff8-18df-42e3-877a-c832276ebb43 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:17.262284 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-9cf85f07-6718-4cd3-8f37-12e21e717f39 req-f9475ff8-18df-42e3-877a-c832276ebb43 service nova] Creating event network-changed:613f87b0-b830-4be7-b6f3-9f48ace26266 for instance 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 on hv-cinder-74915 Oct 14 17:58:17.268319 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-9cf85f07-6718-4cd3-8f37-12e21e717f39 req-f9475ff8-18df-42e3-877a-c832276ebb43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036680 Oct 14 17:58:17.269132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 218/428] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:58:17.274878 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:17.275785 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:17.282810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:17.283517 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:17.284157 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:17.285759 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:17.286252 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:17.286678 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:17.354156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fbbb60c4-af48-4a0c-a025-ef667d35fb24 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:17.363456 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fbbb60c4-af48-4a0c-a025-ef667d35fb24 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1319 microversion: 2.1 time: 0.220445 Oct 14 17:58:17.365564 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 211/429] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:17 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:17.454252 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:17.464689 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:17.467006 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:17.468516 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c2407927-de37-43cf-b71e-e6d48c3debb1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.198006 Oct 14 17:58:17.470255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 219/430] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:17 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:18.388266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-932fb33b-d4e2-4d01-84eb-2f19e0e2cc9b tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:18.388868 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-932fb33b-d4e2-4d01-84eb-2f19e0e2cc9b tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:18.395824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-932fb33b-d4e2-4d01-84eb-2f19e0e2cc9b tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:18.396333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-932fb33b-d4e2-4d01-84eb-2f19e0e2cc9b tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:18.396761 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-932fb33b-d4e2-4d01-84eb-2f19e0e2cc9b tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:18.397443 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-932fb33b-d4e2-4d01-84eb-2f19e0e2cc9b tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:18.397884 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-932fb33b-d4e2-4d01-84eb-2f19e0e2cc9b tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:18.398331 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-932fb33b-d4e2-4d01-84eb-2f19e0e2cc9b tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:18.496435 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:18.497036 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:18.503270 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:18.503905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:18.504601 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:18.505751 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:18.506289 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:18.506848 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:18.530687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-932fb33b-d4e2-4d01-84eb-2f19e0e2cc9b tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:18.539690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-932fb33b-d4e2-4d01-84eb-2f19e0e2cc9b tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1319 microversion: 2.1 time: 0.155247 Oct 14 17:58:18.548372 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 212/431] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:18 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:18.648723 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:18.657575 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:18.659013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:18.660189 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2ebf2eab-bd45-4401-80ec-f372a76b39bd tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.167613 Oct 14 17:58:18.660734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 220/432] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:18 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:18.720757 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ab002af8-fde4-4cdc-9014-4b4a91022e41 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "730a1f79-00d5-4a10-8922-f7d94b75c72a"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:18.723132 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ab002af8-fde4-4cdc-9014-4b4a91022e41 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:18.728952 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ab002af8-fde4-4cdc-9014-4b4a91022e41 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:18.729425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ab002af8-fde4-4cdc-9014-4b4a91022e41 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:18.729851 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ab002af8-fde4-4cdc-9014-4b4a91022e41 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:18.730528 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ab002af8-fde4-4cdc-9014-4b4a91022e41 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:18.730969 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ab002af8-fde4-4cdc-9014-4b4a91022e41 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:18.731386 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ab002af8-fde4-4cdc-9014-4b4a91022e41 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:19.562155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d5e21e98-3d1e-4902-9de9-5f3105e5f4ec tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:19.562753 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d5e21e98-3d1e-4902-9de9-5f3105e5f4ec tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:19.569677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e21e98-3d1e-4902-9de9-5f3105e5f4ec tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:19.570151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e21e98-3d1e-4902-9de9-5f3105e5f4ec tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:19.570573 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e21e98-3d1e-4902-9de9-5f3105e5f4ec tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:19.571244 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e21e98-3d1e-4902-9de9-5f3105e5f4ec tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:19.571684 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e21e98-3d1e-4902-9de9-5f3105e5f4ec tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:19.572190 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e21e98-3d1e-4902-9de9-5f3105e5f4ec tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:19.703533 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d5e21e98-3d1e-4902-9de9-5f3105e5f4ec tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:19.712728 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d5e21e98-3d1e-4902-9de9-5f3105e5f4ec tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1319 microversion: 2.1 time: 0.154416 Oct 14 17:58:19.713630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 221/433] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:19 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:58:19.718817 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:19.719529 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:19.725654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:19.726233 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:19.726838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:19.727527 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:19.728017 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:19.728435 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:19.821908 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ab002af8-fde4-4cdc-9014-4b4a91022e41 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "POST /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.105008 Oct 14 17:58:19.823211 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 213/434] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 17:58:18 2022] POST /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments => generated 194 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:58:19.884356 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:19.898854 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:19.900352 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:19.901657 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8abcf542-7273-493a-80e3-28fe9eb63103 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.186945 Oct 14 17:58:19.902297 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 222/435] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:19 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:20.737915 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-50ebe619-444d-4724-87c3-0cdbcab45f08 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:20.738628 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-50ebe619-444d-4724-87c3-0cdbcab45f08 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:20.745195 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50ebe619-444d-4724-87c3-0cdbcab45f08 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:20.745669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50ebe619-444d-4724-87c3-0cdbcab45f08 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:20.746095 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50ebe619-444d-4724-87c3-0cdbcab45f08 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:20.746766 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50ebe619-444d-4724-87c3-0cdbcab45f08 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:20.747209 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50ebe619-444d-4724-87c3-0cdbcab45f08 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:20.747621 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50ebe619-444d-4724-87c3-0cdbcab45f08 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:20.874963 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-50ebe619-444d-4724-87c3-0cdbcab45f08 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:20.883019 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-50ebe619-444d-4724-87c3-0cdbcab45f08 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1319 microversion: 2.1 time: 0.149861 Oct 14 17:58:20.883574 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 214/436] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:20 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:20.926510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:20.927197 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:20.933322 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:20.933796 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:20.934222 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:20.934901 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:20.935472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:20.944291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:21.076459 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:21.085928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:21.087387 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:21.088701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-01cfb58a-e4ac-4a9c-98cd-6a7163137911 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.166160 Oct 14 17:58:21.089266 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 223/437] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:20 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:21.905627 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8dc8b13e-5d35-4cb0-956a-7178ac35c951 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:21.906224 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8dc8b13e-5d35-4cb0-956a-7178ac35c951 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:21.909470 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:21.914854 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8dc8b13e-5d35-4cb0-956a-7178ac35c951 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:21.915328 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8dc8b13e-5d35-4cb0-956a-7178ac35c951 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:21.915756 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8dc8b13e-5d35-4cb0-956a-7178ac35c951 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:21.916453 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8dc8b13e-5d35-4cb0-956a-7178ac35c951 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:21.916897 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8dc8b13e-5d35-4cb0-956a-7178ac35c951 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:21.917311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8dc8b13e-5d35-4cb0-956a-7178ac35c951 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:21.921314 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:22.116467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:22.117080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:22.120910 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:22.121877 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:22.129484 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:22.130282 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:22.130908 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:22.132564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:22.133211 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:22.134619 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:22.364714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8dc8b13e-5d35-4cb0-956a-7178ac35c951 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:22.368684 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:22.372290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8dc8b13e-5d35-4cb0-956a-7178ac35c951 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1319 microversion: 2.1 time: 0.470481 Oct 14 17:58:22.372866 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 215/438] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:21 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:22.377407 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:22.378915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:22.380176 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-315de37c-a27a-4b62-b54d-dc482a0d4c7d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.268642 Oct 14 17:58:22.380709 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 224/439] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:22 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:58:23.395266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e1300fcb-de94-43c2-ae51-c18467476ba2 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:23.395863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e1300fcb-de94-43c2-ae51-c18467476ba2 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:23.402222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1300fcb-de94-43c2-ae51-c18467476ba2 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:23.402697 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1300fcb-de94-43c2-ae51-c18467476ba2 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:23.403129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1300fcb-de94-43c2-ae51-c18467476ba2 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:23.403802 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1300fcb-de94-43c2-ae51-c18467476ba2 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:23.404271 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1300fcb-de94-43c2-ae51-c18467476ba2 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:23.404685 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1300fcb-de94-43c2-ae51-c18467476ba2 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:23.405447 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:23.406080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:23.412503 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:23.412979 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:23.413405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:23.414490 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:23.414997 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:23.415488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:23.598815 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e1300fcb-de94-43c2-ae51-c18467476ba2 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:23.600689 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:23.607473 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e1300fcb-de94-43c2-ae51-c18467476ba2 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1319 microversion: 2.1 time: 0.216509 Oct 14 17:58:23.620521 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 216/440] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:23 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:23.620733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:23.620733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:23.620733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-268b98d4-a889-4457-9f7e-e8b9f5406573 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.212099 Oct 14 17:58:23.621015 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 225/441] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:23 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:58:23.666274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-54ef6d99-810c-4d58-a07c-ecc103942ce3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:23.666757 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-54ef6d99-810c-4d58-a07c-ecc103942ce3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:23.673285 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54ef6d99-810c-4d58-a07c-ecc103942ce3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:23.673769 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54ef6d99-810c-4d58-a07c-ecc103942ce3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:23.674201 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54ef6d99-810c-4d58-a07c-ecc103942ce3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:23.674893 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54ef6d99-810c-4d58-a07c-ecc103942ce3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:23.675342 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54ef6d99-810c-4d58-a07c-ecc103942ce3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:23.675759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-54ef6d99-810c-4d58-a07c-ecc103942ce3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:23.757367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-54ef6d99-810c-4d58-a07c-ecc103942ce3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lazy-loading 'services' on Instance uuid c8dd3e30-1c69-471e-8b17-4205d267eb94 {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:58:23.758410 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-2ce9a3d7-44bd-406d-b1ed-749ca660e77f req-9c30f4b1-246c-4c4b-aa13-14c405dfd579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c0a43e-1109-4ff9-9617-8a2958de7b0b", "name": "network-vif-plugged", "status": "completed", "tag": "04f9946a-535a-428e-8287-bac5d55cc781"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:23.768733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2ce9a3d7-44bd-406d-b1ed-749ca660e77f req-9c30f4b1-246c-4c4b-aa13-14c405dfd579 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:23.769208 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2ce9a3d7-44bd-406d-b1ed-749ca660e77f req-9c30f4b1-246c-4c4b-aa13-14c405dfd579 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:23.769780 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2ce9a3d7-44bd-406d-b1ed-749ca660e77f req-9c30f4b1-246c-4c4b-aa13-14c405dfd579 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:23.784630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-2ce9a3d7-44bd-406d-b1ed-749ca660e77f req-9c30f4b1-246c-4c4b-aa13-14c405dfd579 service nova] Creating event network-vif-plugged:04f9946a-535a-428e-8287-bac5d55cc781 for instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b on hv-cinder-74915 Oct 14 17:58:23.790856 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-2ce9a3d7-44bd-406d-b1ed-749ca660e77f req-9c30f4b1-246c-4c4b-aa13-14c405dfd579 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036023 Oct 14 17:58:23.791445 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 226/442] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:58:23.835800 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-54ef6d99-810c-4d58-a07c-ecc103942ce3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/os-volume_attachments/d72095a2-8608-4600-80e4-24e9a8311ea8" status: 202 len: 0 microversion: 2.1 time: 0.173524 Oct 14 17:58:23.836661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 217/443] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 17:58:23 2022] DELETE /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/os-volume_attachments/d72095a2-8608-4600-80e4-24e9a8311ea8 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:58:24.632513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c07cea30-43c5-4cbf-a887-6fba28e7cdee tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:24.633206 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c07cea30-43c5-4cbf-a887-6fba28e7cdee tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:24.638641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:24.639334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:24.639434 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c07cea30-43c5-4cbf-a887-6fba28e7cdee tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:24.639849 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c07cea30-43c5-4cbf-a887-6fba28e7cdee tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:24.640314 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c07cea30-43c5-4cbf-a887-6fba28e7cdee tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:24.641005 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c07cea30-43c5-4cbf-a887-6fba28e7cdee tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:24.641456 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c07cea30-43c5-4cbf-a887-6fba28e7cdee tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:24.641872 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c07cea30-43c5-4cbf-a887-6fba28e7cdee tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:24.646603 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:24.647176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:24.647615 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:24.648325 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:24.648772 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:24.649184 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:24.833326 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c07cea30-43c5-4cbf-a887-6fba28e7cdee tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:24.837495 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:24.841044 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c07cea30-43c5-4cbf-a887-6fba28e7cdee tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1319 microversion: 2.1 time: 0.212895 Oct 14 17:58:24.841617 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 227/444] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:24 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:24.845986 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:24.847638 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:24.848805 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-99fe2687-f11a-4371-97b9-de10a0547fb2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.214791 Oct 14 17:58:24.849339 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 218/445] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:24 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:58:25.810794 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-11adf6c3-935f-4402-906f-90fe910f455e req-4d5c86b7-3277-40cb-8d79-3448a2969b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188c63cc-0d29-43b4-b4c9-c42631a8c6d7", "name": "network-vif-plugged", "status": "completed", "tag": "613f87b0-b830-4be7-b6f3-9f48ace26266"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:25.820159 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-11adf6c3-935f-4402-906f-90fe910f455e req-4d5c86b7-3277-40cb-8d79-3448a2969b93 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:25.820629 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-11adf6c3-935f-4402-906f-90fe910f455e req-4d5c86b7-3277-40cb-8d79-3448a2969b93 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:25.821052 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-11adf6c3-935f-4402-906f-90fe910f455e req-4d5c86b7-3277-40cb-8d79-3448a2969b93 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:25.831712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-11adf6c3-935f-4402-906f-90fe910f455e req-4d5c86b7-3277-40cb-8d79-3448a2969b93 service nova] Creating event network-vif-plugged:613f87b0-b830-4be7-b6f3-9f48ace26266 for instance 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 on hv-cinder-74915 Oct 14 17:58:25.836493 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-11adf6c3-935f-4402-906f-90fe910f455e req-4d5c86b7-3277-40cb-8d79-3448a2969b93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029347 Oct 14 17:58:25.837050 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 228/446] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:58:25.865159 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fd21fac7-6511-4a3d-ab84-9b5e0500e317 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:25.865754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fd21fac7-6511-4a3d-ab84-9b5e0500e317 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:25.872533 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21fac7-6511-4a3d-ab84-9b5e0500e317 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:25.873015 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21fac7-6511-4a3d-ab84-9b5e0500e317 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:25.873438 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21fac7-6511-4a3d-ab84-9b5e0500e317 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:25.874116 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21fac7-6511-4a3d-ab84-9b5e0500e317 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:25.874556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21fac7-6511-4a3d-ab84-9b5e0500e317 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:25.874966 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd21fac7-6511-4a3d-ab84-9b5e0500e317 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:25.875190 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:25.875893 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:25.882140 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:25.882618 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:25.883050 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:25.883743 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:25.884227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:25.884645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:25.889450 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=100 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:26.069580 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fd21fac7-6511-4a3d-ab84-9b5e0500e317 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:26.073285 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:26.077217 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fd21fac7-6511-4a3d-ab84-9b5e0500e317 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1319 microversion: 2.1 time: 0.216654 Oct 14 17:58:26.077785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 219/447] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:25 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:26.081757 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:26.083174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:26.084543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-106fdd0d-e50f-4b34-9a08-f0f03136e5aa tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1809 microversion: 2.20 time: 0.213457 Oct 14 17:58:26.085085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 229/448] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:25 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:58:27.100720 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a98727e1-7c61-4167-bceb-94ed82498394 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:27.101323 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a98727e1-7c61-4167-bceb-94ed82498394 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:27.103275 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:27.109452 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a98727e1-7c61-4167-bceb-94ed82498394 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:27.109939 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a98727e1-7c61-4167-bceb-94ed82498394 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:27.110048 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:27.110434 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a98727e1-7c61-4167-bceb-94ed82498394 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:27.110534 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:27.111051 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a98727e1-7c61-4167-bceb-94ed82498394 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:27.111524 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a98727e1-7c61-4167-bceb-94ed82498394 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:27.112007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a98727e1-7c61-4167-bceb-94ed82498394 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:27.116914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:27.117372 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:27.117797 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:27.118478 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:27.118921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:27.119331 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:27.345647 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a98727e1-7c61-4167-bceb-94ed82498394 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:27.353347 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:27.362714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a98727e1-7c61-4167-bceb-94ed82498394 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1319 microversion: 2.1 time: 0.265173 Oct 14 17:58:27.362990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:27.363546 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 220/449] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:27 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:27.376178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:27.376178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f3027812-796b-4ece-97ad-5064bb1142ec tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1796 microversion: 2.20 time: 0.259439 Oct 14 17:58:27.376178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 230/450] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:58:27 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1796 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:58:27.442075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-90e5b17d-b753-42ce-8130-47a7db27a77c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:27.442677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-90e5b17d-b753-42ce-8130-47a7db27a77c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:27.448497 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90e5b17d-b753-42ce-8130-47a7db27a77c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:27.448965 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90e5b17d-b753-42ce-8130-47a7db27a77c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:27.449388 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90e5b17d-b753-42ce-8130-47a7db27a77c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:27.450070 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90e5b17d-b753-42ce-8130-47a7db27a77c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:27.450514 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90e5b17d-b753-42ce-8130-47a7db27a77c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:27.450928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90e5b17d-b753-42ce-8130-47a7db27a77c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:27.585398 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-90e5b17d-b753-42ce-8130-47a7db27a77c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:27.593456 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-90e5b17d-b753-42ce-8130-47a7db27a77c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1593 microversion: 2.1 time: 0.155165 Oct 14 17:58:27.594004 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 231/451] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:27 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:28.386452 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-678aced8-763c-470d-9bad-c605d8925ae8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:28.387072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-678aced8-763c-470d-9bad-c605d8925ae8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:28.396216 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-678aced8-763c-470d-9bad-c605d8925ae8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:28.396709 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-678aced8-763c-470d-9bad-c605d8925ae8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:28.397153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-678aced8-763c-470d-9bad-c605d8925ae8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:28.397853 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-678aced8-763c-470d-9bad-c605d8925ae8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:28.398309 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-678aced8-763c-470d-9bad-c605d8925ae8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:28.398736 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-678aced8-763c-470d-9bad-c605d8925ae8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:28.638283 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-678aced8-763c-470d-9bad-c605d8925ae8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:28.646135 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-678aced8-763c-470d-9bad-c605d8925ae8 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1319 microversion: 2.1 time: 0.263492 Oct 14 17:58:28.646813 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 221/452] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:28 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:28.965956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-cf45e177-1dd9-49ab-96bd-d76ba370edf2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "291db3a3-6c96-4d22-af22-a9787f475274"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:28.968492 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-cf45e177-1dd9-49ab-96bd-d76ba370edf2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:28.975183 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cf45e177-1dd9-49ab-96bd-d76ba370edf2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:28.975669 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cf45e177-1dd9-49ab-96bd-d76ba370edf2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:28.976134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cf45e177-1dd9-49ab-96bd-d76ba370edf2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:28.976828 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cf45e177-1dd9-49ab-96bd-d76ba370edf2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:28.977303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cf45e177-1dd9-49ab-96bd-d76ba370edf2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:28.977834 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cf45e177-1dd9-49ab-96bd-d76ba370edf2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:29.204839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e1f5d819-f151-4774-90e7-bcfa8575acac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:29.211055 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f5d819-f151-4774-90e7-bcfa8575acac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:29.211618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f5d819-f151-4774-90e7-bcfa8575acac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:29.212161 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f5d819-f151-4774-90e7-bcfa8575acac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:29.272303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e1f5d819-f151-4774-90e7-bcfa8575acac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Going to try to stop instance {{(pid=118656) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 14 17:58:29.328970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e1f5d819-f151-4774-90e7-bcfa8575acac tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/action" status: 202 len: 0 microversion: 2.1 time: 0.127694 Oct 14 17:58:29.329939 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 222/453] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:58:29 2022] POST /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 17:58:29.342099 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-413a992d-2631-4811-af02-846e0b107456 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:29.342956 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-413a992d-2631-4811-af02-846e0b107456 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:29.351237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-413a992d-2631-4811-af02-846e0b107456 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:29.351927 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-413a992d-2631-4811-af02-846e0b107456 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:29.352611 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-413a992d-2631-4811-af02-846e0b107456 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:29.353067 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-413a992d-2631-4811-af02-846e0b107456 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:29.353577 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-413a992d-2631-4811-af02-846e0b107456 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:29.354007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-413a992d-2631-4811-af02-846e0b107456 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:29.547826 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-413a992d-2631-4811-af02-846e0b107456 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:29.558020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-413a992d-2631-4811-af02-846e0b107456 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1676 microversion: 2.1 time: 0.219682 Oct 14 17:58:29.559351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 223/454] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:29 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1676 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:29.564996 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-0ea08501-bbbd-4f67-a12d-f677ab8a930b req-5bf4aa35-306c-4f83-835a-d9d255f8cf0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9a8094-ee6e-4a32-96a6-94c18538fd29", "tag": "687bc207-2144-4d90-83f9-83cd2654a936"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:29.576499 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-0ea08501-bbbd-4f67-a12d-f677ab8a930b req-5bf4aa35-306c-4f83-835a-d9d255f8cf0f service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:29.577088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-0ea08501-bbbd-4f67-a12d-f677ab8a930b req-5bf4aa35-306c-4f83-835a-d9d255f8cf0f service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:29.577736 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-0ea08501-bbbd-4f67-a12d-f677ab8a930b req-5bf4aa35-306c-4f83-835a-d9d255f8cf0f service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:29.590401 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-0ea08501-bbbd-4f67-a12d-f677ab8a930b req-5bf4aa35-306c-4f83-835a-d9d255f8cf0f service nova] Creating event network-changed:687bc207-2144-4d90-83f9-83cd2654a936 for instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 on hv-cinder-74915 Oct 14 17:58:29.595437 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-0ea08501-bbbd-4f67-a12d-f677ab8a930b req-5bf4aa35-306c-4f83-835a-d9d255f8cf0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034304 Oct 14 17:58:29.596662 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 224/455] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:58:29.673735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-aa786199-7ece-4960-9024-2c9b0d5d04ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:29.676335 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-aa786199-7ece-4960-9024-2c9b0d5d04ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:29.684241 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aa786199-7ece-4960-9024-2c9b0d5d04ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:29.684965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aa786199-7ece-4960-9024-2c9b0d5d04ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:29.686183 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aa786199-7ece-4960-9024-2c9b0d5d04ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:29.687170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aa786199-7ece-4960-9024-2c9b0d5d04ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:29.687750 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aa786199-7ece-4960-9024-2c9b0d5d04ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:29.688426 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aa786199-7ece-4960-9024-2c9b0d5d04ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:29.779290 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-cf45e177-1dd9-49ab-96bd-d76ba370edf2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817071 Oct 14 17:58:29.780915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 232/456] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 17:58:28 2022] POST /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:58:29.895250 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-aa786199-7ece-4960-9024-2c9b0d5d04ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:29.904434 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-aa786199-7ece-4960-9024-2c9b0d5d04ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1508 microversion: 2.1 time: 0.237911 Oct 14 17:58:29.906358 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 225/457] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:29 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:58:29.940148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-28d3155d-930a-4507-bc11-4183d7dec7d9 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db84d172-49d9-4b38-a283-f6d21fc8e9d8", "device": "/dev/sdb"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:29.944945 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-28d3155d-930a-4507-bc11-4183d7dec7d9 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:29.960577 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28d3155d-930a-4507-bc11-4183d7dec7d9 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:29.961095 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28d3155d-930a-4507-bc11-4183d7dec7d9 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:29.962617 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28d3155d-930a-4507-bc11-4183d7dec7d9 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:29.963333 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28d3155d-930a-4507-bc11-4183d7dec7d9 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:29.965033 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28d3155d-930a-4507-bc11-4183d7dec7d9 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:29.966017 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-28d3155d-930a-4507-bc11-4183d7dec7d9 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:30.350846 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-28d3155d-930a-4507-bc11-4183d7dec7d9 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "POST /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424884 Oct 14 17:58:30.352661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 233/458] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 17:58:29 2022] POST /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:58:30.583306 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8ebc371e-6531-420f-8b86-1784a928bc48 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:30.584625 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8ebc371e-6531-420f-8b86-1784a928bc48 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:30.591299 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ebc371e-6531-420f-8b86-1784a928bc48 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:30.591786 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ebc371e-6531-420f-8b86-1784a928bc48 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:30.592270 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ebc371e-6531-420f-8b86-1784a928bc48 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:30.592972 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ebc371e-6531-420f-8b86-1784a928bc48 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:30.593428 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ebc371e-6531-420f-8b86-1784a928bc48 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:30.593848 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ebc371e-6531-420f-8b86-1784a928bc48 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:30.745320 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-67fdc3e2-38c3-4f5c-8373-4ea621856a71 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-782805704"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:30.745932 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-67fdc3e2-38c3-4f5c-8373-4ea621856a71 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:30.751988 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67fdc3e2-38c3-4f5c-8373-4ea621856a71 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:30.753132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67fdc3e2-38c3-4f5c-8373-4ea621856a71 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:30.753132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67fdc3e2-38c3-4f5c-8373-4ea621856a71 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:30.754121 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67fdc3e2-38c3-4f5c-8373-4ea621856a71 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:30.754593 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67fdc3e2-38c3-4f5c-8373-4ea621856a71 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:30.755197 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67fdc3e2-38c3-4f5c-8373-4ea621856a71 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:30.769662 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8ebc371e-6531-420f-8b86-1784a928bc48 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:30.777405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8ebc371e-6531-420f-8b86-1784a928bc48 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1676 microversion: 2.1 time: 0.198724 Oct 14 17:58:30.778067 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 226/459] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:30 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:58:30.884464 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.network.security_group_api [None req-67fdc3e2-38c3-4f5c-8373-4ea621856a71 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Adding security group ec1e3e5c-00a6-4a33-9fab-4f16b207bdb5 to port 687bc207-2144-4d90-83f9-83cd2654a936 Oct 14 17:58:31.201012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-67fdc3e2-38c3-4f5c-8373-4ea621856a71 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "POST /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/action" status: 202 len: 0 microversion: 2.1 time: 0.460448 Oct 14 17:58:31.201831 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 234/460] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:58:30 2022] POST /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 17:58:31.210950 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-6fa15cc3-0e2b-4096-90b5-438fc92986cb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:31.211664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-6fa15cc3-0e2b-4096-90b5-438fc92986cb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:31.217571 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6fa15cc3-0e2b-4096-90b5-438fc92986cb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:31.218132 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6fa15cc3-0e2b-4096-90b5-438fc92986cb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:31.218636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6fa15cc3-0e2b-4096-90b5-438fc92986cb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:31.219630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6fa15cc3-0e2b-4096-90b5-438fc92986cb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:31.220169 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6fa15cc3-0e2b-4096-90b5-438fc92986cb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:31.220658 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6fa15cc3-0e2b-4096-90b5-438fc92986cb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:31.374278 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6fa15cc3-0e2b-4096-90b5-438fc92986cb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:31.382843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-6fa15cc3-0e2b-4096-90b5-438fc92986cb tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1757 microversion: 2.1 time: 0.175954 Oct 14 17:58:31.383422 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 227/461] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:31 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:31.610658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-e23df3cb-37a5-469f-9246-f34a8565e568 req-9891f430-95a1-44cb-ae6c-571994774f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9a8094-ee6e-4a32-96a6-94c18538fd29", "tag": "687bc207-2144-4d90-83f9-83cd2654a936"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:31.620141 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e23df3cb-37a5-469f-9246-f34a8565e568 req-9891f430-95a1-44cb-ae6c-571994774f6e service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:31.620634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e23df3cb-37a5-469f-9246-f34a8565e568 req-9891f430-95a1-44cb-ae6c-571994774f6e service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:31.621054 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e23df3cb-37a5-469f-9246-f34a8565e568 req-9891f430-95a1-44cb-ae6c-571994774f6e service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:31.632453 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-e23df3cb-37a5-469f-9246-f34a8565e568 req-9891f430-95a1-44cb-ae6c-571994774f6e service nova] Creating event network-changed:687bc207-2144-4d90-83f9-83cd2654a936 for instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 on hv-cinder-74915 Oct 14 17:58:31.637497 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-e23df3cb-37a5-469f-9246-f34a8565e568 req-9891f430-95a1-44cb-ae6c-571994774f6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030914 Oct 14 17:58:31.638471 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 235/462] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:58:31.803251 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3c18959d-9c10-48ff-aabe-14ad8c6a1c2f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:31.804425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3c18959d-9c10-48ff-aabe-14ad8c6a1c2f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:31.810657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3c18959d-9c10-48ff-aabe-14ad8c6a1c2f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:31.811148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3c18959d-9c10-48ff-aabe-14ad8c6a1c2f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:31.811908 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3c18959d-9c10-48ff-aabe-14ad8c6a1c2f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:31.812599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3c18959d-9c10-48ff-aabe-14ad8c6a1c2f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:31.813403 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3c18959d-9c10-48ff-aabe-14ad8c6a1c2f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:31.813535 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3c18959d-9c10-48ff-aabe-14ad8c6a1c2f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:31.945124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3c18959d-9c10-48ff-aabe-14ad8c6a1c2f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:31.952878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3c18959d-9c10-48ff-aabe-14ad8c6a1c2f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1676 microversion: 2.1 time: 0.154182 Oct 14 17:58:31.954055 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 228/463] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:31 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:32.978099 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f2bc0b9d-566a-421d-b555-de4653ff4369 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:32.978788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f2bc0b9d-566a-421d-b555-de4653ff4369 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:32.981264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 17:58:32.981407 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Fri Oct 14 17:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 (ip 10.222.0.27) !!! Oct 14 17:58:32.983320 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:32.992725 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f2bc0b9d-566a-421d-b555-de4653ff4369 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:32.993205 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f2bc0b9d-566a-421d-b555-de4653ff4369 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:32.993637 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f2bc0b9d-566a-421d-b555-de4653ff4369 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:32.994365 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f2bc0b9d-566a-421d-b555-de4653ff4369 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:32.994810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f2bc0b9d-566a-421d-b555-de4653ff4369 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:32.995607 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f2bc0b9d-566a-421d-b555-de4653ff4369 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:33.126946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f2bc0b9d-566a-421d-b555-de4653ff4369 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:33.134585 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f2bc0b9d-566a-421d-b555-de4653ff4369 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1676 microversion: 2.1 time: 0.160820 Oct 14 17:58:33.135148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 236/464] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:32 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:34.156917 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7b6b900a-798b-4109-9d0d-2eb64f6220cd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:34.157514 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7b6b900a-798b-4109-9d0d-2eb64f6220cd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:34.160339 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=72 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:34.165796 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7b6b900a-798b-4109-9d0d-2eb64f6220cd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:34.166272 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7b6b900a-798b-4109-9d0d-2eb64f6220cd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:34.166699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7b6b900a-798b-4109-9d0d-2eb64f6220cd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:34.167375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7b6b900a-798b-4109-9d0d-2eb64f6220cd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:34.167817 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7b6b900a-798b-4109-9d0d-2eb64f6220cd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:34.168259 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7b6b900a-798b-4109-9d0d-2eb64f6220cd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:34.296126 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7b6b900a-798b-4109-9d0d-2eb64f6220cd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:34.304406 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7b6b900a-798b-4109-9d0d-2eb64f6220cd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1676 microversion: 2.1 time: 0.151293 Oct 14 17:58:34.305033 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 229/465] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:34 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:35.327316 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d3787db8-9d0c-4177-aebe-3c61007fecb5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:35.328080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d3787db8-9d0c-4177-aebe-3c61007fecb5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:35.335183 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3787db8-9d0c-4177-aebe-3c61007fecb5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:35.335664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3787db8-9d0c-4177-aebe-3c61007fecb5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:35.336132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3787db8-9d0c-4177-aebe-3c61007fecb5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:35.336820 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3787db8-9d0c-4177-aebe-3c61007fecb5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:35.337271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3787db8-9d0c-4177-aebe-3c61007fecb5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:35.337692 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3787db8-9d0c-4177-aebe-3c61007fecb5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:35.466113 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d3787db8-9d0c-4177-aebe-3c61007fecb5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:35.473844 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d3787db8-9d0c-4177-aebe-3c61007fecb5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1676 microversion: 2.1 time: 0.150348 Oct 14 17:58:35.474406 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 237/466] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:35 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:36.496162 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ee328a8f-a54e-4877-b262-81700b8320c2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:36.497345 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ee328a8f-a54e-4877-b262-81700b8320c2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:36.504909 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ee328a8f-a54e-4877-b262-81700b8320c2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:36.505205 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ee328a8f-a54e-4877-b262-81700b8320c2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:36.505646 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ee328a8f-a54e-4877-b262-81700b8320c2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:36.506354 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ee328a8f-a54e-4877-b262-81700b8320c2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:36.506812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ee328a8f-a54e-4877-b262-81700b8320c2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:36.507235 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ee328a8f-a54e-4877-b262-81700b8320c2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:36.642103 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ee328a8f-a54e-4877-b262-81700b8320c2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:36.646268 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:36.651486 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ee328a8f-a54e-4877-b262-81700b8320c2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1676 microversion: 2.1 time: 0.159209 Oct 14 17:58:36.652079 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 230/467] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:36 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:37.345625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ce0b174c-d434-46b0-a52b-fa8fef7ce5d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:37.347915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ce0b174c-d434-46b0-a52b-fa8fef7ce5d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:37.354364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce0b174c-d434-46b0-a52b-fa8fef7ce5d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:37.354840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce0b174c-d434-46b0-a52b-fa8fef7ce5d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:37.355265 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce0b174c-d434-46b0-a52b-fa8fef7ce5d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:37.355988 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce0b174c-d434-46b0-a52b-fa8fef7ce5d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:37.356434 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce0b174c-d434-46b0-a52b-fa8fef7ce5d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:37.356849 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce0b174c-d434-46b0-a52b-fa8fef7ce5d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:37.380292 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-ce0b174c-d434-46b0-a52b-fa8fef7ce5d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lazy-loading 'flavor' on Instance uuid b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:58:37.498845 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ce0b174c-d434-46b0-a52b-fa8fef7ce5d2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/action" status: 200 len: 32 microversion: 2.1 time: 0.157238 Oct 14 17:58:37.499439 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 238/468] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:58:37 2022] POST /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 17:58:37.509779 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b1943ea0-4ce3-4245-8b77-f1f4a2001096 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:37.510390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b1943ea0-4ce3-4245-8b77-f1f4a2001096 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:37.518637 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b1943ea0-4ce3-4245-8b77-f1f4a2001096 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:37.519131 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b1943ea0-4ce3-4245-8b77-f1f4a2001096 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:37.519705 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b1943ea0-4ce3-4245-8b77-f1f4a2001096 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:37.520526 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b1943ea0-4ce3-4245-8b77-f1f4a2001096 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:37.520981 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b1943ea0-4ce3-4245-8b77-f1f4a2001096 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:37.521407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b1943ea0-4ce3-4245-8b77-f1f4a2001096 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:37.653550 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b1943ea0-4ce3-4245-8b77-f1f4a2001096 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:37.662838 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b1943ea0-4ce3-4245-8b77-f1f4a2001096 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.156899 Oct 14 17:58:37.663402 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 231/469] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:37 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:37.675124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8cd7cc53-4210-4709-933c-80839a391d0f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:37.676423 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8cd7cc53-4210-4709-933c-80839a391d0f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:37.682601 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8cd7cc53-4210-4709-933c-80839a391d0f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:37.683088 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8cd7cc53-4210-4709-933c-80839a391d0f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:37.683520 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8cd7cc53-4210-4709-933c-80839a391d0f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:37.684244 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8cd7cc53-4210-4709-933c-80839a391d0f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:37.684699 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8cd7cc53-4210-4709-933c-80839a391d0f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:37.685121 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8cd7cc53-4210-4709-933c-80839a391d0f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:37.821974 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8cd7cc53-4210-4709-933c-80839a391d0f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:37.829953 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8cd7cc53-4210-4709-933c-80839a391d0f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1676 microversion: 2.1 time: 0.158993 Oct 14 17:58:37.830769 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 239/470] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:37 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:38.686492 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-80cdcc8d-2958-4872-9a82-1539cd9c745a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:38.687095 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-80cdcc8d-2958-4872-9a82-1539cd9c745a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:38.694465 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80cdcc8d-2958-4872-9a82-1539cd9c745a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:38.694951 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80cdcc8d-2958-4872-9a82-1539cd9c745a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:38.695382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80cdcc8d-2958-4872-9a82-1539cd9c745a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:38.696105 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80cdcc8d-2958-4872-9a82-1539cd9c745a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:38.696561 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80cdcc8d-2958-4872-9a82-1539cd9c745a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:38.696978 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80cdcc8d-2958-4872-9a82-1539cd9c745a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:38.821494 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-80cdcc8d-2958-4872-9a82-1539cd9c745a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:38.829517 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-80cdcc8d-2958-4872-9a82-1539cd9c745a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.146858 Oct 14 17:58:38.830082 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 232/471] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:38 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:38.854243 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-23c142db-7f6d-46d0-85eb-a7ae0a24cd36 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:38.854836 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-23c142db-7f6d-46d0-85eb-a7ae0a24cd36 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:38.861571 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23c142db-7f6d-46d0-85eb-a7ae0a24cd36 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:38.862045 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23c142db-7f6d-46d0-85eb-a7ae0a24cd36 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:38.862469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23c142db-7f6d-46d0-85eb-a7ae0a24cd36 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:38.863150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23c142db-7f6d-46d0-85eb-a7ae0a24cd36 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:38.864622 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23c142db-7f6d-46d0-85eb-a7ae0a24cd36 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:38.865046 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23c142db-7f6d-46d0-85eb-a7ae0a24cd36 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:38.992695 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-23c142db-7f6d-46d0-85eb-a7ae0a24cd36 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:39.000351 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-23c142db-7f6d-46d0-85eb-a7ae0a24cd36 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1676 microversion: 2.1 time: 0.149836 Oct 14 17:58:39.000913 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 240/472] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:38 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:39.852405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bc99e157-885a-4fce-a932-f3fc0f533fc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:39.853115 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-bc99e157-885a-4fce-a932-f3fc0f533fc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:39.859663 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc99e157-885a-4fce-a932-f3fc0f533fc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:39.860171 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc99e157-885a-4fce-a932-f3fc0f533fc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:39.860600 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc99e157-885a-4fce-a932-f3fc0f533fc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:39.861275 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc99e157-885a-4fce-a932-f3fc0f533fc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:39.861725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc99e157-885a-4fce-a932-f3fc0f533fc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:39.862137 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc99e157-885a-4fce-a932-f3fc0f533fc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:39.993014 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-bc99e157-885a-4fce-a932-f3fc0f533fc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:40.001015 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-bc99e157-885a-4fce-a932-f3fc0f533fc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.152464 Oct 14 17:58:40.001579 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 233/473] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:39 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:40.025178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6097bcb4-b7a4-4bdd-a3d3-622aaeaed8ef tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:40.025776 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6097bcb4-b7a4-4bdd-a3d3-622aaeaed8ef tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:40.032004 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6097bcb4-b7a4-4bdd-a3d3-622aaeaed8ef tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:40.032476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6097bcb4-b7a4-4bdd-a3d3-622aaeaed8ef tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:40.032898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6097bcb4-b7a4-4bdd-a3d3-622aaeaed8ef tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:40.033570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6097bcb4-b7a4-4bdd-a3d3-622aaeaed8ef tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:40.034012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6097bcb4-b7a4-4bdd-a3d3-622aaeaed8ef tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:40.034424 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6097bcb4-b7a4-4bdd-a3d3-622aaeaed8ef tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:40.161634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6097bcb4-b7a4-4bdd-a3d3-622aaeaed8ef tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:40.169557 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6097bcb4-b7a4-4bdd-a3d3-622aaeaed8ef tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1653 microversion: 2.1 time: 0.148096 Oct 14 17:58:40.170042 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 241/474] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:40 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1653 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:40.193598 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4e1e0fa6-2054-4acb-bf5e-b4ca2e1e3d13 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:40.199497 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e1e0fa6-2054-4acb-bf5e-b4ca2e1e3d13 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:40.200001 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e1e0fa6-2054-4acb-bf5e-b4ca2e1e3d13 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:40.200428 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e1e0fa6-2054-4acb-bf5e-b4ca2e1e3d13 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:40.221779 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4e1e0fa6-2054-4acb-bf5e-b4ca2e1e3d13 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Going to try to start instance {{(pid=118656) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 14 17:58:40.263015 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4e1e0fa6-2054-4acb-bf5e-b4ca2e1e3d13 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/action" status: 202 len: 0 microversion: 2.1 time: 0.074078 Oct 14 17:58:40.263829 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 234/475] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:58:40 2022] POST /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:58:40.272761 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-959a7755-9d6f-4a5b-870b-9e164d145420 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:40.273892 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-959a7755-9d6f-4a5b-870b-9e164d145420 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:40.279498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-959a7755-9d6f-4a5b-870b-9e164d145420 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:40.280012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-959a7755-9d6f-4a5b-870b-9e164d145420 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:40.280436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-959a7755-9d6f-4a5b-870b-9e164d145420 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:40.281121 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-959a7755-9d6f-4a5b-870b-9e164d145420 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:40.281563 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-959a7755-9d6f-4a5b-870b-9e164d145420 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:40.282003 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-959a7755-9d6f-4a5b-870b-9e164d145420 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:40.287042 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:40.423173 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-959a7755-9d6f-4a5b-870b-9e164d145420 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:40.431853 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-959a7755-9d6f-4a5b-870b-9e164d145420 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1662 microversion: 2.1 time: 0.163354 Oct 14 17:58:40.432664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 242/476] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:40 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:41.025635 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c83c7e05-5db4-44b4-93f7-ad98d5a347d1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:41.026325 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c83c7e05-5db4-44b4-93f7-ad98d5a347d1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:41.032768 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83c7e05-5db4-44b4-93f7-ad98d5a347d1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:41.033271 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83c7e05-5db4-44b4-93f7-ad98d5a347d1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:41.033702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83c7e05-5db4-44b4-93f7-ad98d5a347d1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:41.034377 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83c7e05-5db4-44b4-93f7-ad98d5a347d1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:41.034818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83c7e05-5db4-44b4-93f7-ad98d5a347d1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:41.036360 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83c7e05-5db4-44b4-93f7-ad98d5a347d1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:41.168255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c83c7e05-5db4-44b4-93f7-ad98d5a347d1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:41.176734 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c83c7e05-5db4-44b4-93f7-ad98d5a347d1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.155181 Oct 14 17:58:41.177305 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 235/477] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:41 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:41.455963 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a84e13d0-54ce-40eb-8b47-ef641de4b9e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:41.456670 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a84e13d0-54ce-40eb-8b47-ef641de4b9e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:41.463898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a84e13d0-54ce-40eb-8b47-ef641de4b9e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:41.464395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a84e13d0-54ce-40eb-8b47-ef641de4b9e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:41.464865 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a84e13d0-54ce-40eb-8b47-ef641de4b9e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:41.465564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a84e13d0-54ce-40eb-8b47-ef641de4b9e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:41.466134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a84e13d0-54ce-40eb-8b47-ef641de4b9e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:41.466568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a84e13d0-54ce-40eb-8b47-ef641de4b9e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:41.600343 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a84e13d0-54ce-40eb-8b47-ef641de4b9e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:41.608292 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a84e13d0-54ce-40eb-8b47-ef641de4b9e0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1662 microversion: 2.1 time: 0.156110 Oct 14 17:58:41.608780 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 243/478] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:41 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:42.199473 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a1475be0-78f3-4c78-9d2e-ea4a56627524 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:42.200180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a1475be0-78f3-4c78-9d2e-ea4a56627524 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:42.206694 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1475be0-78f3-4c78-9d2e-ea4a56627524 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:42.207254 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1475be0-78f3-4c78-9d2e-ea4a56627524 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:42.207724 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1475be0-78f3-4c78-9d2e-ea4a56627524 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:42.208434 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1475be0-78f3-4c78-9d2e-ea4a56627524 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:42.208890 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1475be0-78f3-4c78-9d2e-ea4a56627524 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:42.209312 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1475be0-78f3-4c78-9d2e-ea4a56627524 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:42.338138 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a1475be0-78f3-4c78-9d2e-ea4a56627524 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:42.346287 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a1475be0-78f3-4c78-9d2e-ea4a56627524 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.150621 Oct 14 17:58:42.346869 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 236/479] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:42 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:42.631725 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a42dead9-52b4-45c2-956d-3a4ac99ea3f6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:42.632358 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a42dead9-52b4-45c2-956d-3a4ac99ea3f6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:42.638650 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a42dead9-52b4-45c2-956d-3a4ac99ea3f6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:42.639126 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a42dead9-52b4-45c2-956d-3a4ac99ea3f6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:42.639555 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a42dead9-52b4-45c2-956d-3a4ac99ea3f6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:42.640272 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a42dead9-52b4-45c2-956d-3a4ac99ea3f6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:42.640727 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a42dead9-52b4-45c2-956d-3a4ac99ea3f6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:42.641143 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a42dead9-52b4-45c2-956d-3a4ac99ea3f6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:42.768643 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a42dead9-52b4-45c2-956d-3a4ac99ea3f6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:42.776986 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a42dead9-52b4-45c2-956d-3a4ac99ea3f6 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1666 microversion: 2.1 time: 0.149340 Oct 14 17:58:42.777539 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 244/480] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:42 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1666 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:43.369968 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c2bcafe4-808a-4bf7-944b-f2f9b7abe89e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:43.370696 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c2bcafe4-808a-4bf7-944b-f2f9b7abe89e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:43.377090 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2bcafe4-808a-4bf7-944b-f2f9b7abe89e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:43.377646 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2bcafe4-808a-4bf7-944b-f2f9b7abe89e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:43.378146 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2bcafe4-808a-4bf7-944b-f2f9b7abe89e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:43.378975 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2bcafe4-808a-4bf7-944b-f2f9b7abe89e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:43.379469 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2bcafe4-808a-4bf7-944b-f2f9b7abe89e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:43.380119 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2bcafe4-808a-4bf7-944b-f2f9b7abe89e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:43.750977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c2bcafe4-808a-4bf7-944b-f2f9b7abe89e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:43.759226 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c2bcafe4-808a-4bf7-944b-f2f9b7abe89e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.393168 Oct 14 17:58:43.759794 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 237/481] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:43 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:44.781697 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-75845115-2a44-426b-a452-06c38604cb81 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:44.782237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-75845115-2a44-426b-a452-06c38604cb81 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:44.789125 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75845115-2a44-426b-a452-06c38604cb81 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:44.789603 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75845115-2a44-426b-a452-06c38604cb81 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:44.790285 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75845115-2a44-426b-a452-06c38604cb81 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:44.790962 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75845115-2a44-426b-a452-06c38604cb81 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:44.791409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75845115-2a44-426b-a452-06c38604cb81 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:44.791821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-75845115-2a44-426b-a452-06c38604cb81 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:44.918171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-75845115-2a44-426b-a452-06c38604cb81 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:44.926767 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-75845115-2a44-426b-a452-06c38604cb81 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.148497 Oct 14 17:58:44.927333 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 245/482] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:44 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:45.950363 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e1f59c49-f14c-425d-a76c-413ec0ecda5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:45.950960 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e1f59c49-f14c-425d-a76c-413ec0ecda5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:45.958407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f59c49-f14c-425d-a76c-413ec0ecda5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:45.958889 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f59c49-f14c-425d-a76c-413ec0ecda5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:45.959317 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f59c49-f14c-425d-a76c-413ec0ecda5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:45.960037 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f59c49-f14c-425d-a76c-413ec0ecda5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:45.960489 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f59c49-f14c-425d-a76c-413ec0ecda5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:45.960904 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f59c49-f14c-425d-a76c-413ec0ecda5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:46.088962 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e1f59c49-f14c-425d-a76c-413ec0ecda5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:46.096963 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e1f59c49-f14c-425d-a76c-413ec0ecda5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.150516 Oct 14 17:58:46.097523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 238/483] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:45 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:47.120914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-294d4544-d536-4f10-b83f-e35e50123cf9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:47.121538 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-294d4544-d536-4f10-b83f-e35e50123cf9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:47.129130 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-294d4544-d536-4f10-b83f-e35e50123cf9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:47.130847 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-294d4544-d536-4f10-b83f-e35e50123cf9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:47.131291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-294d4544-d536-4f10-b83f-e35e50123cf9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:47.132097 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-294d4544-d536-4f10-b83f-e35e50123cf9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:47.132556 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-294d4544-d536-4f10-b83f-e35e50123cf9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:47.132976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-294d4544-d536-4f10-b83f-e35e50123cf9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:47.266978 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-294d4544-d536-4f10-b83f-e35e50123cf9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:47.276059 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-294d4544-d536-4f10-b83f-e35e50123cf9 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.158430 Oct 14 17:58:47.276303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 246/484] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:47 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:48.298840 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-dbd8ed7e-e068-4760-8d2f-3629ba27aa55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:48.299446 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-dbd8ed7e-e068-4760-8d2f-3629ba27aa55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:48.306777 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dbd8ed7e-e068-4760-8d2f-3629ba27aa55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:48.307290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dbd8ed7e-e068-4760-8d2f-3629ba27aa55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:48.307718 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dbd8ed7e-e068-4760-8d2f-3629ba27aa55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:48.308432 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dbd8ed7e-e068-4760-8d2f-3629ba27aa55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:48.308880 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dbd8ed7e-e068-4760-8d2f-3629ba27aa55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:48.309295 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dbd8ed7e-e068-4760-8d2f-3629ba27aa55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:48.438735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-dbd8ed7e-e068-4760-8d2f-3629ba27aa55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:48.447899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-dbd8ed7e-e068-4760-8d2f-3629ba27aa55 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.152859 Oct 14 17:58:48.448474 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 239/485] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:48 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:49.471066 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-af166302-c98c-48c3-9c28-b00d2105e5a6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:49.471700 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-af166302-c98c-48c3-9c28-b00d2105e5a6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:49.478749 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-af166302-c98c-48c3-9c28-b00d2105e5a6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:49.479231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-af166302-c98c-48c3-9c28-b00d2105e5a6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:49.479667 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-af166302-c98c-48c3-9c28-b00d2105e5a6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:49.480378 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-af166302-c98c-48c3-9c28-b00d2105e5a6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:49.480833 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-af166302-c98c-48c3-9c28-b00d2105e5a6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:49.481254 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-af166302-c98c-48c3-9c28-b00d2105e5a6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:49.606732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-af166302-c98c-48c3-9c28-b00d2105e5a6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:49.614937 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-af166302-c98c-48c3-9c28-b00d2105e5a6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.147831 Oct 14 17:58:49.615491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 247/486] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:49 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:50.638586 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b3e708ea-9dfc-464d-a1e5-a3c57fc52c9b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:50.639210 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b3e708ea-9dfc-464d-a1e5-a3c57fc52c9b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:50.648269 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b3e708ea-9dfc-464d-a1e5-a3c57fc52c9b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:50.648761 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b3e708ea-9dfc-464d-a1e5-a3c57fc52c9b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:50.649190 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b3e708ea-9dfc-464d-a1e5-a3c57fc52c9b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:50.650651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b3e708ea-9dfc-464d-a1e5-a3c57fc52c9b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:50.651488 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b3e708ea-9dfc-464d-a1e5-a3c57fc52c9b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:50.651939 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b3e708ea-9dfc-464d-a1e5-a3c57fc52c9b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:50.801668 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b3e708ea-9dfc-464d-a1e5-a3c57fc52c9b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:50.810104 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b3e708ea-9dfc-464d-a1e5-a3c57fc52c9b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.175374 Oct 14 17:58:50.810680 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 240/487] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:50 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:51.833379 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8dc2d52d-552b-49e7-bdc4-98fe9c1592d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:51.833977 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8dc2d52d-552b-49e7-bdc4-98fe9c1592d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:51.840839 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dc2d52d-552b-49e7-bdc4-98fe9c1592d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:51.841345 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dc2d52d-552b-49e7-bdc4-98fe9c1592d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:51.841772 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dc2d52d-552b-49e7-bdc4-98fe9c1592d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:51.842459 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dc2d52d-552b-49e7-bdc4-98fe9c1592d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:51.842905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dc2d52d-552b-49e7-bdc4-98fe9c1592d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:51.843318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dc2d52d-552b-49e7-bdc4-98fe9c1592d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:51.978265 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8dc2d52d-552b-49e7-bdc4-98fe9c1592d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:51.986269 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8dc2d52d-552b-49e7-bdc4-98fe9c1592d5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.156760 Oct 14 17:58:51.986831 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 248/488] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:51 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:53.011361 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-6b1c3aa9-32dc-4b42-80fe-150c1cfce5a5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:53.011951 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-6b1c3aa9-32dc-4b42-80fe-150c1cfce5a5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:53.018831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b1c3aa9-32dc-4b42-80fe-150c1cfce5a5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:53.019313 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b1c3aa9-32dc-4b42-80fe-150c1cfce5a5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:53.019749 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b1c3aa9-32dc-4b42-80fe-150c1cfce5a5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:53.020754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b1c3aa9-32dc-4b42-80fe-150c1cfce5a5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:53.021215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b1c3aa9-32dc-4b42-80fe-150c1cfce5a5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:53.021657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b1c3aa9-32dc-4b42-80fe-150c1cfce5a5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:53.147277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6b1c3aa9-32dc-4b42-80fe-150c1cfce5a5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:53.155454 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-6b1c3aa9-32dc-4b42-80fe-150c1cfce5a5 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.148996 Oct 14 17:58:53.156058 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 241/489] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:53 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:54.178784 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0d1e4528-dd79-46c9-993d-139029a39a38 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:54.179379 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0d1e4528-dd79-46c9-993d-139029a39a38 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:54.185694 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1e4528-dd79-46c9-993d-139029a39a38 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:54.186168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1e4528-dd79-46c9-993d-139029a39a38 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:54.186595 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1e4528-dd79-46c9-993d-139029a39a38 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:54.187271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1e4528-dd79-46c9-993d-139029a39a38 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:54.187715 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1e4528-dd79-46c9-993d-139029a39a38 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:54.188159 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0d1e4528-dd79-46c9-993d-139029a39a38 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:54.317589 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0d1e4528-dd79-46c9-993d-139029a39a38 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:54.325791 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0d1e4528-dd79-46c9-993d-139029a39a38 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.150813 Oct 14 17:58:54.326347 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 249/490] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:54 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:55.349969 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-01a25143-2eb5-480d-9436-e605ebabfc5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:55.350847 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-01a25143-2eb5-480d-9436-e605ebabfc5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:55.357826 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01a25143-2eb5-480d-9436-e605ebabfc5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:55.358312 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01a25143-2eb5-480d-9436-e605ebabfc5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:55.358746 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01a25143-2eb5-480d-9436-e605ebabfc5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:55.359444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01a25143-2eb5-480d-9436-e605ebabfc5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:55.359913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01a25143-2eb5-480d-9436-e605ebabfc5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:55.360368 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01a25143-2eb5-480d-9436-e605ebabfc5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:55.488351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-01a25143-2eb5-480d-9436-e605ebabfc5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:55.496655 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-01a25143-2eb5-480d-9436-e605ebabfc5a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.151194 Oct 14 17:58:55.497227 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 242/491] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:55 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:56.083477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dc33f115-835a-48dc-93bd-c5b384b849ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:56.084072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-dc33f115-835a-48dc-93bd-c5b384b849ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:56.090412 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc33f115-835a-48dc-93bd-c5b384b849ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:56.090883 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc33f115-835a-48dc-93bd-c5b384b849ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:56.091303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc33f115-835a-48dc-93bd-c5b384b849ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:56.092003 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc33f115-835a-48dc-93bd-c5b384b849ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:56.092447 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc33f115-835a-48dc-93bd-c5b384b849ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:56.092860 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc33f115-835a-48dc-93bd-c5b384b849ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:56.216136 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-dc33f115-835a-48dc-93bd-c5b384b849ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lazy-loading 'services' on Instance uuid 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:58:56.327314 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-dc33f115-835a-48dc-93bd-c5b384b849ad tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7/os-volume_attachments/db84d172-49d9-4b38-a283-f6d21fc8e9d8" status: 202 len: 0 microversion: 2.1 time: 0.247678 Oct 14 17:58:56.328075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 250/492] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 17:58:56 2022] DELETE /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7/os-volume_attachments/db84d172-49d9-4b38-a283-f6d21fc8e9d8 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:58:56.520226 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d4d17054-3911-470c-9e23-a1f07d6b1fa6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:56.520873 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d4d17054-3911-470c-9e23-a1f07d6b1fa6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:56.527235 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d4d17054-3911-470c-9e23-a1f07d6b1fa6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:56.527718 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d4d17054-3911-470c-9e23-a1f07d6b1fa6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:56.528193 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d4d17054-3911-470c-9e23-a1f07d6b1fa6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:56.528887 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d4d17054-3911-470c-9e23-a1f07d6b1fa6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:56.529341 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d4d17054-3911-470c-9e23-a1f07d6b1fa6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:56.529765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d4d17054-3911-470c-9e23-a1f07d6b1fa6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:56.657641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d4d17054-3911-470c-9e23-a1f07d6b1fa6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:56.666818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d4d17054-3911-470c-9e23-a1f07d6b1fa6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.150305 Oct 14 17:58:56.667410 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 243/493] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:56 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:57.450430 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9d97013d-c4a5-4a87-b4d0-7967f1d64ded tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:57.451015 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9d97013d-c4a5-4a87-b4d0-7967f1d64ded tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:57.457052 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d97013d-c4a5-4a87-b4d0-7967f1d64ded tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:57.457553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d97013d-c4a5-4a87-b4d0-7967f1d64ded tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:57.457999 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d97013d-c4a5-4a87-b4d0-7967f1d64ded tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:57.458706 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d97013d-c4a5-4a87-b4d0-7967f1d64ded tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:57.459171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d97013d-c4a5-4a87-b4d0-7967f1d64ded tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:57.459585 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d97013d-c4a5-4a87-b4d0-7967f1d64ded tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:57.483698 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9d97013d-c4a5-4a87-b4d0-7967f1d64ded tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 17:58:57.561839 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9d97013d-c4a5-4a87-b4d0-7967f1d64ded tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 204 len: 0 microversion: 2.1 time: 0.115814 Oct 14 17:58:57.562568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 251/494] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 17:58:57 2022] DELETE /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 17:58:57.573286 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-03b8124d-6c80-43c7-98fb-b560e66b2ccd tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:57.573916 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-03b8124d-6c80-43c7-98fb-b560e66b2ccd tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:57.580170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-03b8124d-6c80-43c7-98fb-b560e66b2ccd tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:57.580653 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-03b8124d-6c80-43c7-98fb-b560e66b2ccd tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:57.581077 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-03b8124d-6c80-43c7-98fb-b560e66b2ccd tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:57.581752 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-03b8124d-6c80-43c7-98fb-b560e66b2ccd tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:57.582197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-03b8124d-6c80-43c7-98fb-b560e66b2ccd tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:57.582616 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-03b8124d-6c80-43c7-98fb-b560e66b2ccd tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:57.690843 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-507e2e23-0af4-4b43-91cc-b4f14ca0ab6c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:57.691576 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-507e2e23-0af4-4b43-91cc-b4f14ca0ab6c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:57.698321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-507e2e23-0af4-4b43-91cc-b4f14ca0ab6c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:57.698807 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-507e2e23-0af4-4b43-91cc-b4f14ca0ab6c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:57.699242 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-507e2e23-0af4-4b43-91cc-b4f14ca0ab6c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:57.699959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-507e2e23-0af4-4b43-91cc-b4f14ca0ab6c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:57.700414 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-507e2e23-0af4-4b43-91cc-b4f14ca0ab6c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:57.700833 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-507e2e23-0af4-4b43-91cc-b4f14ca0ab6c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:57.718471 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-03b8124d-6c80-43c7-98fb-b560e66b2ccd tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:57.727267 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-03b8124d-6c80-43c7-98fb-b560e66b2ccd tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1514 microversion: 2.1 time: 0.159994 Oct 14 17:58:57.727838 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 244/495] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:57 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:57.830663 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-507e2e23-0af4-4b43-91cc-b4f14ca0ab6c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:57.838957 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-507e2e23-0af4-4b43-91cc-b4f14ca0ab6c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.152343 Oct 14 17:58:57.839519 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 252/496] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:57 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:58:58.751144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3995b50d-74ee-475d-91d7-60294667d1ed tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:58.751750 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3995b50d-74ee-475d-91d7-60294667d1ed tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:58.758676 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3995b50d-74ee-475d-91d7-60294667d1ed tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:58.759153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3995b50d-74ee-475d-91d7-60294667d1ed tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:58.759617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3995b50d-74ee-475d-91d7-60294667d1ed tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:58.760316 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3995b50d-74ee-475d-91d7-60294667d1ed tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:58.760767 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3995b50d-74ee-475d-91d7-60294667d1ed tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:58.761185 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3995b50d-74ee-475d-91d7-60294667d1ed tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:58.862440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-29fc8cc4-ec76-4aaa-9aaa-998355f37218 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:58.863040 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-29fc8cc4-ec76-4aaa-9aaa-998355f37218 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:58.869976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-29fc8cc4-ec76-4aaa-9aaa-998355f37218 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:58.870459 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-29fc8cc4-ec76-4aaa-9aaa-998355f37218 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:58.870891 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-29fc8cc4-ec76-4aaa-9aaa-998355f37218 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:58.871605 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-29fc8cc4-ec76-4aaa-9aaa-998355f37218 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:58.872084 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-29fc8cc4-ec76-4aaa-9aaa-998355f37218 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:58.872522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-29fc8cc4-ec76-4aaa-9aaa-998355f37218 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:58.892142 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3995b50d-74ee-475d-91d7-60294667d1ed tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:58.899809 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3995b50d-74ee-475d-91d7-60294667d1ed tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1514 microversion: 2.1 time: 0.152436 Oct 14 17:58:58.900515 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 245/497] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:58 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:58:58.998750 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-29fc8cc4-ec76-4aaa-9aaa-998355f37218 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:58:59.008124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-29fc8cc4-ec76-4aaa-9aaa-998355f37218 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.149400 Oct 14 17:58:59.008616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 253/498] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:58 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:58:59.904035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-10c5e402-7d3c-462c-849c-be282ee535dd req-25735029-50a9-494d-8706-bc214bbe137e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188c63cc-0d29-43b4-b4c9-c42631a8c6d7", "name": "network-vif-deleted", "tag": "613f87b0-b830-4be7-b6f3-9f48ace26266"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:58:59.914849 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-10c5e402-7d3c-462c-849c-be282ee535dd req-25735029-50a9-494d-8706-bc214bbe137e service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:59.915323 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-10c5e402-7d3c-462c-849c-be282ee535dd req-25735029-50a9-494d-8706-bc214bbe137e service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:59.916036 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-10c5e402-7d3c-462c-849c-be282ee535dd req-25735029-50a9-494d-8706-bc214bbe137e service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:59.922258 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5915b1c0-1ce8-482f-b363-5a5f91e65e2f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:58:59.922854 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5915b1c0-1ce8-482f-b363-5a5f91e65e2f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:58:59.926742 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-10c5e402-7d3c-462c-849c-be282ee535dd req-25735029-50a9-494d-8706-bc214bbe137e service nova] Creating event network-vif-deleted:613f87b0-b830-4be7-b6f3-9f48ace26266 for instance 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 on hv-cinder-74915 Oct 14 17:58:59.928858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5915b1c0-1ce8-482f-b363-5a5f91e65e2f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:59.929334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5915b1c0-1ce8-482f-b363-5a5f91e65e2f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:59.929760 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5915b1c0-1ce8-482f-b363-5a5f91e65e2f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:59.931272 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5915b1c0-1ce8-482f-b363-5a5f91e65e2f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:58:59.931726 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5915b1c0-1ce8-482f-b363-5a5f91e65e2f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:58:59.932174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5915b1c0-1ce8-482f-b363-5a5f91e65e2f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:58:59.932280 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-10c5e402-7d3c-462c-849c-be282ee535dd req-25735029-50a9-494d-8706-bc214bbe137e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031905 Oct 14 17:58:59.932843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 246/499] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:58:59.992728 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5915b1c0-1ce8-482f-b363-5a5f91e65e2f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:00.000219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5915b1c0-1ce8-482f-b363-5a5f91e65e2f tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1472 microversion: 2.1 time: 0.081647 Oct 14 17:59:00.000783 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 254/500] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:58:59 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1472 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:59:00.030982 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b78977cd-171d-430d-983c-28728adb2cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:00.031799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b78977cd-171d-430d-983c-28728adb2cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:00.037945 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b78977cd-171d-430d-983c-28728adb2cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:00.038426 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b78977cd-171d-430d-983c-28728adb2cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:00.038862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b78977cd-171d-430d-983c-28728adb2cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:00.039553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b78977cd-171d-430d-983c-28728adb2cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:00.040040 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b78977cd-171d-430d-983c-28728adb2cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:00.040467 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b78977cd-171d-430d-983c-28728adb2cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:00.044659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:00.172107 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b78977cd-171d-430d-983c-28728adb2cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:00.180571 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b78977cd-171d-430d-983c-28728adb2cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.153743 Oct 14 17:59:00.181334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 247/501] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:00 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:01.023256 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:01.023805 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:01.030120 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:01.030593 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:01.031019 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:01.031698 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:01.032182 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:01.032594 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:01.062842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:01.063315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:01.063735 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:01.064203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lazy-loading 'fault' on Instance uuid 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:59:01.105339 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a23bceab9e14ee8907eef2a2df85799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f786f7363e44d78e478f2fec202f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:01.112972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-79c6370f-a22e-4c7d-bc73-651902a15e0e tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 200 len: 1309 microversion: 2.1 time: 0.094328 Oct 14 17:59:01.113526 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 255/502] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:01 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:01.203637 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7fa72305-65f8-46af-be8e-0a2aa510bc6e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:01.204329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7fa72305-65f8-46af-be8e-0a2aa510bc6e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:01.210201 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fa72305-65f8-46af-be8e-0a2aa510bc6e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:01.210678 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fa72305-65f8-46af-be8e-0a2aa510bc6e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:01.211108 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fa72305-65f8-46af-be8e-0a2aa510bc6e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:01.211786 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fa72305-65f8-46af-be8e-0a2aa510bc6e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:01.212255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fa72305-65f8-46af-be8e-0a2aa510bc6e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:01.212671 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7fa72305-65f8-46af-be8e-0a2aa510bc6e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:01.336588 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7fa72305-65f8-46af-be8e-0a2aa510bc6e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:01.344621 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7fa72305-65f8-46af-be8e-0a2aa510bc6e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.145018 Oct 14 17:59:01.345181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 248/503] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:01 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:02.137622 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:02.138157 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] [instance: 188c63cc-0d29-43b4-b4c9-c42631a8c6d7] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:02.144634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:02.145118 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:02.145552 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:02.146243 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:02.147463 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:02.148088 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:02.152117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:02.163826 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] HTTP exception thrown: Instance 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 could not be found. Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Request method failure captured: Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 HTTP/1.1 Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaLjWKbjP-Uch4Z6pZIXws-BYSiEsBvw02Jk9-D8XW6x88oYdJ6eVUa-CHJqODQ5hm2tmdAReSVmNqMDqLI_n0lRPM_nDHvlF574pf4tjWU8Oek8IaV4OiKc42cXJc-HGYaWXL4leEoXEUfOCw0IqF5qxQd0-gIWrDlvssbW4SbKQ6U Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 19f786f7363e44d78e478f2fec202f4d Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-VolumesSnapshotTestJSON-334156454 Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 17:59:02.165610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19f786f7363e44d78e478f2fec202f4d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f786f7363e44d78e478f2fec202f4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19f786f7363e44d78e478f2fec202f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19f786f7363e44d78e478f2fec202f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-VolumesSnapshotTestJSON-334156454 Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 19f786f7363e44d78e478f2fec202f4d Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-334156454 Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-VolumesSnapshotTestJSON-334156454-project Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 1a23bceab9e14ee8907eef2a2df85799 Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-VolumesSnapshotTestJSON-334156454-project Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 could not be found. Oct 14 17:59:02.167415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '188c63cc-0d29-43b4-b4c9-c42631a8c6d7'} Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 could not be found. Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:59:02.168264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 could not be found. Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 could not be found. Oct 14 17:59:02.169716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:02.170810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] Returning 404 to user: Instance 188c63cc-0d29-43b4-b4c9-c42631a8c6d7 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:59:02.170810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3690735a-1d03-4b68-86bf-23bde29d2e15 tempest-VolumesSnapshotTestJSON-334156454 tempest-VolumesSnapshotTestJSON-334156454-project] 10.222.0.27 "GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7" status: 404 len: 111 microversion: 2.1 time: 0.034033 Oct 14 17:59:02.170810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 256/504] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:02 2022] GET /compute/v2.1/servers/188c63cc-0d29-43b4-b4c9-c42631a8c6d7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 17:59:02.367913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bf300e89-4b2e-4216-814d-476b920954cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:02.369087 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-bf300e89-4b2e-4216-814d-476b920954cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:02.375576 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf300e89-4b2e-4216-814d-476b920954cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:02.376093 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf300e89-4b2e-4216-814d-476b920954cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:02.376525 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf300e89-4b2e-4216-814d-476b920954cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:02.377219 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf300e89-4b2e-4216-814d-476b920954cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:02.377665 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf300e89-4b2e-4216-814d-476b920954cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:02.378418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf300e89-4b2e-4216-814d-476b920954cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:02.524054 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-bf300e89-4b2e-4216-814d-476b920954cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:02.532063 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-bf300e89-4b2e-4216-814d-476b920954cd tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1736 microversion: 2.1 time: 0.168256 Oct 14 17:59:02.532629 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 249/505] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:02 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:03.555027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-125f69c2-6c78-49b0-bce4-f2c8179bdb06 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:03.555639 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-125f69c2-6c78-49b0-bce4-f2c8179bdb06 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:03.559278 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:03.564456 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-125f69c2-6c78-49b0-bce4-f2c8179bdb06 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:03.564935 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-125f69c2-6c78-49b0-bce4-f2c8179bdb06 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:03.565370 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-125f69c2-6c78-49b0-bce4-f2c8179bdb06 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:03.566070 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-125f69c2-6c78-49b0-bce4-f2c8179bdb06 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:03.566524 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-125f69c2-6c78-49b0-bce4-f2c8179bdb06 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:03.566940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-125f69c2-6c78-49b0-bce4-f2c8179bdb06 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:03.721579 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-125f69c2-6c78-49b0-bce4-f2c8179bdb06 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:03.730581 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-125f69c2-6c78-49b0-bce4-f2c8179bdb06 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1716 microversion: 2.1 time: 0.179550 Oct 14 17:59:03.731133 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 257/506] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:03 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1716 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:03.795370 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:03.795932 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:03.802599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:03.803864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:03.804334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:03.805041 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:03.805491 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:03.805915 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:03.895041 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] HTTP exception thrown: Cannot 'detach_volume' instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 while it is in vm_state rescued Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Request method failure captured: Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: DELETE /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments/291db3a3-6c96-4d22-af22-a9787f475274 HTTP/1.1 Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaKDmRrof5YHVAQuXH5mCmDyChagswaliw2J6djtI1m1MzfFbX_OeNHyKd6c1qH-kQE6f6YepZsCS80ByX10HmAJEJ4z6UGwvEVyJkW_2zz4EnwAkiavkywX7UaHyl4vi6r80kNDj3tqM4-o-KGZziEuY7SpETnctapai-BZfnW-4co Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 530fdfc3448a40b7aa85170873d3f0ff Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 17:59:03.897187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_530fdfc3448a40b7aa85170873d3f0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 530fdfc3448a40b7aa85170873d3f0ff Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-ServerRescueNegativeTestJSON-155189197-project Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: c091bf027839447da4c713deb291ed1f Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-ServerRescueNegativeTestJSON-155189197-project Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 17:59:03.898645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Cannot 'detach_volume' instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 while it is in vm_state rescued Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'server_id': 'b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5', 'id': '291db3a3-6c96-4d22-af22-a9787f475274'} Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:59:03.899375 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 while it is in vm_state rescued Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 while it is in vm_state rescued Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 17:59:03.901222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Returning 409 to user: Cannot 'detach_volume' instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 while it is in vm_state rescued {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:59:03.902379 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2ca7eaa3-639c-48de-a497-be68d92315bc tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments/291db3a3-6c96-4d22-af22-a9787f475274" status: 409 len: 152 microversion: 2.1 time: 0.107598 Oct 14 17:59:03.902379 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 250/507] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 17:59:03 2022] DELETE /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments/291db3a3-6c96-4d22-af22-a9787f475274 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 14 17:59:03.907854 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4c86538c-88f1-42df-8410-f618d7149b27 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:03.908480 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4c86538c-88f1-42df-8410-f618d7149b27 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:03.915050 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c86538c-88f1-42df-8410-f618d7149b27 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:03.915606 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c86538c-88f1-42df-8410-f618d7149b27 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:03.916756 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c86538c-88f1-42df-8410-f618d7149b27 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:03.917544 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c86538c-88f1-42df-8410-f618d7149b27 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:03.918056 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c86538c-88f1-42df-8410-f618d7149b27 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:03.918540 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c86538c-88f1-42df-8410-f618d7149b27 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:03.987398 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4c86538c-88f1-42df-8410-f618d7149b27 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "POST /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/action" status: 202 len: 0 microversion: 2.1 time: 0.083232 Oct 14 17:59:03.988124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 258/508] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:59:03 2022] POST /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:59:03.996589 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e3bc6fb1-15d9-4f11-bddf-92d516da900e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:03.997196 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e3bc6fb1-15d9-4f11-bddf-92d516da900e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:04.003386 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3bc6fb1-15d9-4f11-bddf-92d516da900e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:04.003910 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3bc6fb1-15d9-4f11-bddf-92d516da900e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:04.004617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3bc6fb1-15d9-4f11-bddf-92d516da900e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:04.005239 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3bc6fb1-15d9-4f11-bddf-92d516da900e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:04.005983 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3bc6fb1-15d9-4f11-bddf-92d516da900e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:04.006913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3bc6fb1-15d9-4f11-bddf-92d516da900e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:04.141222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e3bc6fb1-15d9-4f11-bddf-92d516da900e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:04.150427 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e3bc6fb1-15d9-4f11-bddf-92d516da900e tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1724 microversion: 2.1 time: 0.157464 Oct 14 17:59:04.150921 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 251/509] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:03 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:05.174327 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9ca2d7e2-da01-48f2-91fe-c463222dd093 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:05.175052 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9ca2d7e2-da01-48f2-91fe-c463222dd093 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:05.182228 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ca2d7e2-da01-48f2-91fe-c463222dd093 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:05.182710 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ca2d7e2-da01-48f2-91fe-c463222dd093 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:05.183147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ca2d7e2-da01-48f2-91fe-c463222dd093 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:05.183838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ca2d7e2-da01-48f2-91fe-c463222dd093 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:05.184315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ca2d7e2-da01-48f2-91fe-c463222dd093 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:05.184738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ca2d7e2-da01-48f2-91fe-c463222dd093 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:05.317777 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9ca2d7e2-da01-48f2-91fe-c463222dd093 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:05.325948 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9ca2d7e2-da01-48f2-91fe-c463222dd093 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1724 microversion: 2.1 time: 0.155804 Oct 14 17:59:05.326506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 259/510] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:05 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:06.348622 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9f463a38-5c1f-422b-9cd7-c686ab9fa9e4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:06.349290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9f463a38-5c1f-422b-9cd7-c686ab9fa9e4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:06.352210 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=46 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:06.357506 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f463a38-5c1f-422b-9cd7-c686ab9fa9e4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:06.357991 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f463a38-5c1f-422b-9cd7-c686ab9fa9e4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:06.358425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f463a38-5c1f-422b-9cd7-c686ab9fa9e4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:06.359119 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f463a38-5c1f-422b-9cd7-c686ab9fa9e4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:06.359572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f463a38-5c1f-422b-9cd7-c686ab9fa9e4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:06.360030 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f463a38-5c1f-422b-9cd7-c686ab9fa9e4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:06.493839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-9f463a38-5c1f-422b-9cd7-c686ab9fa9e4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:06.502391 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9f463a38-5c1f-422b-9cd7-c686ab9fa9e4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1724 microversion: 2.1 time: 0.157599 Oct 14 17:59:06.502960 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 252/511] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:06 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:07.526004 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-11b66856-0cf5-4d51-adcc-fc96ddecce02 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:07.526641 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-11b66856-0cf5-4d51-adcc-fc96ddecce02 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:07.533267 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-11b66856-0cf5-4d51-adcc-fc96ddecce02 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:07.533745 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-11b66856-0cf5-4d51-adcc-fc96ddecce02 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:07.534174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-11b66856-0cf5-4d51-adcc-fc96ddecce02 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:07.534856 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-11b66856-0cf5-4d51-adcc-fc96ddecce02 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:07.535304 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-11b66856-0cf5-4d51-adcc-fc96ddecce02 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:07.535770 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-11b66856-0cf5-4d51-adcc-fc96ddecce02 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:07.664609 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-11b66856-0cf5-4d51-adcc-fc96ddecce02 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:07.673252 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-11b66856-0cf5-4d51-adcc-fc96ddecce02 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1724 microversion: 2.1 time: 0.151627 Oct 14 17:59:07.673864 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 260/512] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:07 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:08.696970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ed1f7165-bfe2-4ddd-b5ce-7758f6e6b2f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:08.697572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ed1f7165-bfe2-4ddd-b5ce-7758f6e6b2f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:08.704122 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed1f7165-bfe2-4ddd-b5ce-7758f6e6b2f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:08.704599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed1f7165-bfe2-4ddd-b5ce-7758f6e6b2f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:08.705030 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed1f7165-bfe2-4ddd-b5ce-7758f6e6b2f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:08.705709 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed1f7165-bfe2-4ddd-b5ce-7758f6e6b2f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:08.706157 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed1f7165-bfe2-4ddd-b5ce-7758f6e6b2f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:08.706579 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ed1f7165-bfe2-4ddd-b5ce-7758f6e6b2f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:08.834297 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ed1f7165-bfe2-4ddd-b5ce-7758f6e6b2f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:08.842799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ed1f7165-bfe2-4ddd-b5ce-7758f6e6b2f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1724 microversion: 2.1 time: 0.150684 Oct 14 17:59:08.843597 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 253/513] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:08 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:09.866150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-eb77bf95-7bfd-4530-99a4-9cb547241c43 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:09.866795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-eb77bf95-7bfd-4530-99a4-9cb547241c43 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:09.873016 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb77bf95-7bfd-4530-99a4-9cb547241c43 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:09.873511 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb77bf95-7bfd-4530-99a4-9cb547241c43 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:09.873936 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb77bf95-7bfd-4530-99a4-9cb547241c43 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:09.874625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb77bf95-7bfd-4530-99a4-9cb547241c43 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:09.875073 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb77bf95-7bfd-4530-99a4-9cb547241c43 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:09.875496 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-eb77bf95-7bfd-4530-99a4-9cb547241c43 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:10.004634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-eb77bf95-7bfd-4530-99a4-9cb547241c43 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:10.013256 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-eb77bf95-7bfd-4530-99a4-9cb547241c43 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1730 microversion: 2.1 time: 0.151210 Oct 14 17:59:10.013813 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 261/514] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:09 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:10.035773 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2f861aeb-4606-4637-b83a-03e510d92c72 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:10.036333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2f861aeb-4606-4637-b83a-03e510d92c72 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:10.042732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f861aeb-4606-4637-b83a-03e510d92c72 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:10.043204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f861aeb-4606-4637-b83a-03e510d92c72 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:10.043630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f861aeb-4606-4637-b83a-03e510d92c72 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:10.044335 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f861aeb-4606-4637-b83a-03e510d92c72 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:10.044782 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f861aeb-4606-4637-b83a-03e510d92c72 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:10.045198 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f861aeb-4606-4637-b83a-03e510d92c72 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:10.121329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2f861aeb-4606-4637-b83a-03e510d92c72 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089312 Oct 14 17:59:10.121918 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 254/515] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Oct 14 17:59:10 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:11.020623 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-6cfd5cfa-f70a-46cc-8d36-6ac0d287b879 req-656e0e5d-bbdb-4aab-9010-5a58f855e2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5", "tag": "6276aa8e-78da-45f2-9027-e54c0e8353b7"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:11.031316 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-6cfd5cfa-f70a-46cc-8d36-6ac0d287b879 req-656e0e5d-bbdb-4aab-9010-5a58f855e2b1 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:11.032057 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-6cfd5cfa-f70a-46cc-8d36-6ac0d287b879 req-656e0e5d-bbdb-4aab-9010-5a58f855e2b1 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:11.032604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-6cfd5cfa-f70a-46cc-8d36-6ac0d287b879 req-656e0e5d-bbdb-4aab-9010-5a58f855e2b1 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:11.047293 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-6cfd5cfa-f70a-46cc-8d36-6ac0d287b879 req-656e0e5d-bbdb-4aab-9010-5a58f855e2b1 service nova] Creating event network-changed:6276aa8e-78da-45f2-9027-e54c0e8353b7 for instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 on hv-cinder-74915 Oct 14 17:59:11.052236 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-6cfd5cfa-f70a-46cc-8d36-6ac0d287b879 req-656e0e5d-bbdb-4aab-9010-5a58f855e2b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035374 Oct 14 17:59:11.054190 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 262/516] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:13.066966 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-829646d9-25f2-4dc6-8327-d2ebb462c19d req-a9736738-2ca4-475d-b81d-e74669f82639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5", "tag": "6276aa8e-78da-45f2-9027-e54c0e8353b7"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:13.076865 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-829646d9-25f2-4dc6-8327-d2ebb462c19d req-a9736738-2ca4-475d-b81d-e74669f82639 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:13.077347 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-829646d9-25f2-4dc6-8327-d2ebb462c19d req-a9736738-2ca4-475d-b81d-e74669f82639 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:13.077780 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-829646d9-25f2-4dc6-8327-d2ebb462c19d req-a9736738-2ca4-475d-b81d-e74669f82639 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:13.089156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-829646d9-25f2-4dc6-8327-d2ebb462c19d req-a9736738-2ca4-475d-b81d-e74669f82639 service nova] Creating event network-changed:6276aa8e-78da-45f2-9027-e54c0e8353b7 for instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 on hv-cinder-74915 Oct 14 17:59:13.094029 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-829646d9-25f2-4dc6-8327-d2ebb462c19d req-a9736738-2ca4-475d-b81d-e74669f82639 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031448 Oct 14 17:59:13.094588 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 255/517] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:14.039719 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b0dee60a-2bc8-4cf8-8a62-11b154bf79dc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:14.042329 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b0dee60a-2bc8-4cf8-8a62-11b154bf79dc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:14.048371 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0dee60a-2bc8-4cf8-8a62-11b154bf79dc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:14.048875 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0dee60a-2bc8-4cf8-8a62-11b154bf79dc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:14.049307 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0dee60a-2bc8-4cf8-8a62-11b154bf79dc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:14.049987 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0dee60a-2bc8-4cf8-8a62-11b154bf79dc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:14.050430 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0dee60a-2bc8-4cf8-8a62-11b154bf79dc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:14.050854 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0dee60a-2bc8-4cf8-8a62-11b154bf79dc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:14.120659 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b0dee60a-2bc8-4cf8-8a62-11b154bf79dc tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "POST /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/action" status: 202 len: 0 microversion: 2.1 time: 0.085607 Oct 14 17:59:14.121439 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 263/518] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 17:59:14 2022] POST /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:59:14.132159 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-000bf370-7153-4a76-9a2b-bb11e46529a5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:14.132853 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-000bf370-7153-4a76-9a2b-bb11e46529a5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:14.139170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-000bf370-7153-4a76-9a2b-bb11e46529a5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:14.139659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-000bf370-7153-4a76-9a2b-bb11e46529a5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:14.140125 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-000bf370-7153-4a76-9a2b-bb11e46529a5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:14.140820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-000bf370-7153-4a76-9a2b-bb11e46529a5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:14.141275 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-000bf370-7153-4a76-9a2b-bb11e46529a5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:14.141701 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-000bf370-7153-4a76-9a2b-bb11e46529a5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:14.285595 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-000bf370-7153-4a76-9a2b-bb11e46529a5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:14.294568 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-000bf370-7153-4a76-9a2b-bb11e46529a5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1749 microversion: 2.1 time: 0.168727 Oct 14 17:59:14.295063 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 256/519] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:14 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:15.319792 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6a8fb4e9-bba7-419b-8520-f2c77c671d95 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:15.320666 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6a8fb4e9-bba7-419b-8520-f2c77c671d95 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:15.326880 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6a8fb4e9-bba7-419b-8520-f2c77c671d95 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:15.327442 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6a8fb4e9-bba7-419b-8520-f2c77c671d95 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:15.328040 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6a8fb4e9-bba7-419b-8520-f2c77c671d95 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:15.328816 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6a8fb4e9-bba7-419b-8520-f2c77c671d95 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:15.329342 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6a8fb4e9-bba7-419b-8520-f2c77c671d95 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:15.329834 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6a8fb4e9-bba7-419b-8520-f2c77c671d95 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:15.576527 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6a8fb4e9-bba7-419b-8520-f2c77c671d95 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:15.585337 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6a8fb4e9-bba7-419b-8520-f2c77c671d95 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1749 microversion: 2.1 time: 0.270963 Oct 14 17:59:15.586002 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 264/520] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:15 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1749 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:16.608655 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c81c5602-ade5-4113-8162-07d7b64a9d10 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:16.609257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c81c5602-ade5-4113-8162-07d7b64a9d10 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:16.615691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c81c5602-ade5-4113-8162-07d7b64a9d10 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:16.616223 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c81c5602-ade5-4113-8162-07d7b64a9d10 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:16.616651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c81c5602-ade5-4113-8162-07d7b64a9d10 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:16.617329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c81c5602-ade5-4113-8162-07d7b64a9d10 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:16.617774 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c81c5602-ade5-4113-8162-07d7b64a9d10 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:16.618190 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c81c5602-ade5-4113-8162-07d7b64a9d10 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:16.706575 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ce20ca21-94ba-4188-80be-9d218fac62e6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:16.707092 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ce20ca21-94ba-4188-80be-9d218fac62e6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:16.715331 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce20ca21-94ba-4188-80be-9d218fac62e6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:16.715828 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce20ca21-94ba-4188-80be-9d218fac62e6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:16.716289 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce20ca21-94ba-4188-80be-9d218fac62e6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:16.717097 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce20ca21-94ba-4188-80be-9d218fac62e6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:16.717550 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce20ca21-94ba-4188-80be-9d218fac62e6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:16.717961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce20ca21-94ba-4188-80be-9d218fac62e6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:16.748472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ce20ca21-94ba-4188-80be-9d218fac62e6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-volume_attachments/31b2fbf3-4cd7-4dd7-b01e-d7e5c3b774d8" status: 200 len: 194 microversion: 2.20 time: 0.045695 Oct 14 17:59:16.749480 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 265/521] 10.222.0.27 () {60 vars in 1454 bytes} [Fri Oct 14 17:59:16 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-volume_attachments/31b2fbf3-4cd7-4dd7-b01e-d7e5c3b774d8 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 17:59:16.764915 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c81c5602-ade5-4113-8162-07d7b64a9d10 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:16.774120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c81c5602-ade5-4113-8162-07d7b64a9d10 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1754 microversion: 2.1 time: 0.169283 Oct 14 17:59:16.774782 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 257/522] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:16 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:16.821525 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dbf80960-41d1-4a03-b866-2bbf727b5ad2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:16.822006 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-dbf80960-41d1-4a03-b866-2bbf727b5ad2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:16.827727 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf80960-41d1-4a03-b866-2bbf727b5ad2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:16.828223 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf80960-41d1-4a03-b866-2bbf727b5ad2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:16.828647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf80960-41d1-4a03-b866-2bbf727b5ad2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:16.829316 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf80960-41d1-4a03-b866-2bbf727b5ad2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:16.829756 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf80960-41d1-4a03-b866-2bbf727b5ad2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:16.830167 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dbf80960-41d1-4a03-b866-2bbf727b5ad2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:16.909289 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-dbf80960-41d1-4a03-b866-2bbf727b5ad2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lazy-loading 'services' on Instance uuid 58c0a43e-1109-4ff9-9617-8a2958de7b0b {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:59:16.978533 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-dbf80960-41d1-4a03-b866-2bbf727b5ad2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-volume_attachments/31b2fbf3-4cd7-4dd7-b01e-d7e5c3b774d8" status: 202 len: 0 microversion: 2.20 time: 0.161902 Oct 14 17:59:16.979128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 266/523] 10.222.0.27 () {60 vars in 1457 bytes} [Fri Oct 14 17:59:16 2022] DELETE /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-volume_attachments/31b2fbf3-4cd7-4dd7-b01e-d7e5c3b774d8 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 14 17:59:16.987600 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4d29c195-9606-4008-992a-01a3b491b009 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:16.989838 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4d29c195-9606-4008-992a-01a3b491b009 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:16.996252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4d29c195-9606-4008-992a-01a3b491b009 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:16.996731 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4d29c195-9606-4008-992a-01a3b491b009 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:16.997156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4d29c195-9606-4008-992a-01a3b491b009 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:16.997841 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4d29c195-9606-4008-992a-01a3b491b009 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:16.998364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4d29c195-9606-4008-992a-01a3b491b009 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:16.998799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4d29c195-9606-4008-992a-01a3b491b009 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:17.029975 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4d29c195-9606-4008-992a-01a3b491b009 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046320 Oct 14 17:59:17.030532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 258/524] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Oct 14 17:59:16 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:59:17.800377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d6fa4b59-311e-4aaf-bf6d-9bef66807e98 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:17.801074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d6fa4b59-311e-4aaf-bf6d-9bef66807e98 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:17.807259 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6fa4b59-311e-4aaf-bf6d-9bef66807e98 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:17.807734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6fa4b59-311e-4aaf-bf6d-9bef66807e98 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:17.808207 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6fa4b59-311e-4aaf-bf6d-9bef66807e98 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:17.808931 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6fa4b59-311e-4aaf-bf6d-9bef66807e98 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:17.809376 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6fa4b59-311e-4aaf-bf6d-9bef66807e98 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:17.809800 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d6fa4b59-311e-4aaf-bf6d-9bef66807e98 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:17.968338 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d6fa4b59-311e-4aaf-bf6d-9bef66807e98 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:17.977309 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d6fa4b59-311e-4aaf-bf6d-9bef66807e98 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1754 microversion: 2.1 time: 0.181940 Oct 14 17:59:17.977869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 267/525] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:17 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:18.043025 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-04bf08f4-6ddd-487a-9073-2c194a3bb56a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:18.045247 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-04bf08f4-6ddd-487a-9073-2c194a3bb56a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:18.051522 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04bf08f4-6ddd-487a-9073-2c194a3bb56a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:18.052042 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04bf08f4-6ddd-487a-9073-2c194a3bb56a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:18.052476 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04bf08f4-6ddd-487a-9073-2c194a3bb56a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:18.053172 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04bf08f4-6ddd-487a-9073-2c194a3bb56a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:18.053623 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04bf08f4-6ddd-487a-9073-2c194a3bb56a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:18.054039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-04bf08f4-6ddd-487a-9073-2c194a3bb56a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:18.082690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-04bf08f4-6ddd-487a-9073-2c194a3bb56a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043803 Oct 14 17:59:18.083257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 259/526] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Oct 14 17:59:18 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:18.146689 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4fd43ebe-41e4-4aa4-a28f-64fe11fdca33 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:18.147717 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4fd43ebe-41e4-4aa4-a28f-64fe11fdca33 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:18.153645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd43ebe-41e4-4aa4-a28f-64fe11fdca33 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:18.154091 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd43ebe-41e4-4aa4-a28f-64fe11fdca33 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:18.154518 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd43ebe-41e4-4aa4-a28f-64fe11fdca33 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:18.155191 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd43ebe-41e4-4aa4-a28f-64fe11fdca33 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:18.155633 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd43ebe-41e4-4aa4-a28f-64fe11fdca33 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:18.156087 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd43ebe-41e4-4aa4-a28f-64fe11fdca33 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:18.179987 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4fd43ebe-41e4-4aa4-a28f-64fe11fdca33 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 17:59:18.252931 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4fd43ebe-41e4-4aa4-a28f-64fe11fdca33 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 204 len: 0 microversion: 2.20 time: 0.109799 Oct 14 17:59:18.253509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 268/527] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Oct 14 17:59:18 2022] DELETE /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 17:59:18.264524 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:18.265131 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:18.271058 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:18.271542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:18.272737 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:18.273694 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:18.274153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:18.274577 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:18.402282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:18.410256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:18.411632 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:18.412803 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b5d4f0fb-8449-4b48-b7f7-bda8076e086c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.153829 Oct 14 17:59:18.413365 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 260/528] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:18 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:19.001091 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6fd9bf66-a998-4df2-b5dc-816ba7e8a629 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:19.001717 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6fd9bf66-a998-4df2-b5dc-816ba7e8a629 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:19.008284 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6fd9bf66-a998-4df2-b5dc-816ba7e8a629 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:19.008777 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6fd9bf66-a998-4df2-b5dc-816ba7e8a629 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:19.009216 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6fd9bf66-a998-4df2-b5dc-816ba7e8a629 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:19.009904 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6fd9bf66-a998-4df2-b5dc-816ba7e8a629 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:19.010360 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6fd9bf66-a998-4df2-b5dc-816ba7e8a629 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:19.010778 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6fd9bf66-a998-4df2-b5dc-816ba7e8a629 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:19.155614 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6fd9bf66-a998-4df2-b5dc-816ba7e8a629 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:19.159306 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:19.165306 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6fd9bf66-a998-4df2-b5dc-816ba7e8a629 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1754 microversion: 2.1 time: 0.168535 Oct 14 17:59:19.165870 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 269/529] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:18 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:19.440256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:19.440853 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:19.447892 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:19.448378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:19.448804 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:19.449479 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:19.449926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:19.450344 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:19.575280 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:19.583153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:19.585233 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:19.586367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-6ba79ed5-db6c-4000-b29b-73c7ac10dc1b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.149945 Oct 14 17:59:19.586919 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 261/530] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:19 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:20.188047 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8dba1077-33ca-43a9-8b61-219f70177073 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:20.188668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8dba1077-33ca-43a9-8b61-219f70177073 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:20.197089 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dba1077-33ca-43a9-8b61-219f70177073 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:20.197574 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dba1077-33ca-43a9-8b61-219f70177073 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:20.198009 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dba1077-33ca-43a9-8b61-219f70177073 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:20.198705 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dba1077-33ca-43a9-8b61-219f70177073 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:20.199154 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dba1077-33ca-43a9-8b61-219f70177073 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:20.199570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dba1077-33ca-43a9-8b61-219f70177073 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:20.446705 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8dba1077-33ca-43a9-8b61-219f70177073 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:20.454657 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8dba1077-33ca-43a9-8b61-219f70177073 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1754 microversion: 2.1 time: 0.270465 Oct 14 17:59:20.455216 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 270/531] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:20 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1754 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:20.611929 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:20.612539 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:20.620786 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:20.621602 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:20.622882 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:20.623704 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:20.624251 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:20.624843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:20.837770 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:20.847073 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:20.848548 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:20.849706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c0bbf36e-9ce0-47e0-b58d-5a8f96923ad9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1724 microversion: 2.20 time: 0.241746 Oct 14 17:59:20.850826 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 262/532] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:20 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:21.459862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-fdced089-69e2-4d49-b6a6-b9a0f0f43b19 req-e461c238-e913-4bb2-85e8-95ff0dcb1422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c0a43e-1109-4ff9-9617-8a2958de7b0b", "name": "network-vif-deleted", "tag": "04f9946a-535a-428e-8287-bac5d55cc781"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:21.471364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-fdced089-69e2-4d49-b6a6-b9a0f0f43b19 req-e461c238-e913-4bb2-85e8-95ff0dcb1422 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:21.472115 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-fdced089-69e2-4d49-b6a6-b9a0f0f43b19 req-e461c238-e913-4bb2-85e8-95ff0dcb1422 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:21.472728 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-fdced089-69e2-4d49-b6a6-b9a0f0f43b19 req-e461c238-e913-4bb2-85e8-95ff0dcb1422 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:21.478756 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c3b146e9-aa3b-4bd0-8bcc-1d853ef07ee8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:21.479678 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c3b146e9-aa3b-4bd0-8bcc-1d853ef07ee8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:21.490128 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3b146e9-aa3b-4bd0-8bcc-1d853ef07ee8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:21.491451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3b146e9-aa3b-4bd0-8bcc-1d853ef07ee8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:21.492114 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3b146e9-aa3b-4bd0-8bcc-1d853ef07ee8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:21.498405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3b146e9-aa3b-4bd0-8bcc-1d853ef07ee8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:21.498946 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3b146e9-aa3b-4bd0-8bcc-1d853ef07ee8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:21.499447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3b146e9-aa3b-4bd0-8bcc-1d853ef07ee8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:21.508294 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-fdced089-69e2-4d49-b6a6-b9a0f0f43b19 req-e461c238-e913-4bb2-85e8-95ff0dcb1422 service nova] Creating event network-vif-deleted:04f9946a-535a-428e-8287-bac5d55cc781 for instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b on hv-cinder-74915 Oct 14 17:59:21.526068 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-fdced089-69e2-4d49-b6a6-b9a0f0f43b19 req-e461c238-e913-4bb2-85e8-95ff0dcb1422 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067932 Oct 14 17:59:21.531017 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 271/533] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:21.674257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c3b146e9-aa3b-4bd0-8bcc-1d853ef07ee8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:21.686622 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c3b146e9-aa3b-4bd0-8bcc-1d853ef07ee8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1754 microversion: 2.1 time: 0.211546 Oct 14 17:59:21.703148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 263/534] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:21 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1754 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:21.877317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:21.878038 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:21.885203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:21.885767 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:21.886271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:21.887044 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:21.887569 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:21.888107 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:21.926381 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:21.926857 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:21.927435 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:21.927894 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lazy-loading 'fault' on Instance uuid 58c0a43e-1109-4ff9-9617-8a2958de7b0b {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:59:21.983543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:21.994781 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:21.998712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:22.000194 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-758e2cee-d44c-4787-9dbe-783fdbb33842 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 200 len: 1371 microversion: 2.20 time: 0.127404 Oct 14 17:59:22.001659 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 272/535] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:21 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 1371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:22.711136 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a457a04b-7081-4f06-82fc-6b89b6a584fd tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:22.711690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a457a04b-7081-4f06-82fc-6b89b6a584fd tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:22.718031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a457a04b-7081-4f06-82fc-6b89b6a584fd tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:22.718512 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a457a04b-7081-4f06-82fc-6b89b6a584fd tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:22.718938 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a457a04b-7081-4f06-82fc-6b89b6a584fd tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:22.719619 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a457a04b-7081-4f06-82fc-6b89b6a584fd tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:22.720097 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a457a04b-7081-4f06-82fc-6b89b6a584fd tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:22.720516 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a457a04b-7081-4f06-82fc-6b89b6a584fd tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:22.862518 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a457a04b-7081-4f06-82fc-6b89b6a584fd tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:22.866063 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=100 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:22.872192 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a457a04b-7081-4f06-82fc-6b89b6a584fd tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1754 microversion: 2.1 time: 0.165395 Oct 14 17:59:22.874182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 264/536] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:22 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:23.026977 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:23.027521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:23.034008 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:23.034492 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:23.034924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:23.035618 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:23.036098 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:23.036516 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:23.050992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] HTTP exception thrown: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Request method failure captured: Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b HTTP/1.1 Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaKDv4hRuhlp7e0CvXFseoQcs1wl5PoyKJURIXVfRv3nrRWq0BZJGV6685-PYkgfUGZCNOerZDnJRnhCm9TzOrKIjyljnaRXT1DbfYIBbQY8Z9NK9JQoDFA00VhVCgBE3dsO0bYal6mMKtACtktZuOfy4QXjuVSwQhwpaN3Ht63HEx8 Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 17:59:23.052701 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_261d62defa42436cbcc5e712c62b76f4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: b9187955c3cf4b77ba86e67a6f378e6a Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 17:59:23.055188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '58c0a43e-1109-4ff9-9617-8a2958de7b0b'} Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:59:23.056137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 17:59:23.057362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:23.058438 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Returning 404 to user: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:59:23.058438 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3e0bc3fd-df9c-46a4-9102-741cd05832c5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 404 len: 111 microversion: 2.20 time: 0.032324 Oct 14 17:59:23.058438 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 273/537] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:23 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 14 17:59:23.064639 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9f9b6d9b-c7aa-426c-813d-47a36d0ab7f0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '.version_select at 0x7fe3da4faee0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:23.089742 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9f9b6d9b-c7aa-426c-813d-47a36d0ab7f0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121262332" status: 204 len: 0 microversion: 2.20 time: 0.028850 Oct 14 17:59:23.092228 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 265/538] 10.222.0.27 () {60 vars in 1262 bytes} [Fri Oct 14 17:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121262332 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 17:59:23.811833 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-830dc1b1-3194-4d9a-89f8-4ff2627397cb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Action: 'create', calling method: .version_select at 0x7fe3da77f280>, body: {"keypair": {"name": "tempest-keypair-1724033438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqasxvVDLDUurBplX04VCq3S4ejtAujMYSz/aVUqzQzz0HHtVN9CufVNXJsef7zvX0XjAYhPmyg0XxazATpIwplMMOfTfaZKCWjMshPZuW7hXfYn4wYwNjxWIy/KHEMhg=="}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:23.828056 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-830dc1b1-3194-4d9a-89f8-4ff2627397cb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Getting quotas for project 261d62defa42436cbcc5e712c62b76f4. Resources: {'key_pairs'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:59:23.832281 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-830dc1b1-3194-4d9a-89f8-4ff2627397cb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Getting quotas for user b9187955c3cf4b77ba86e67a6f378e6a and project 261d62defa42436cbcc5e712c62b76f4. Resources: {'key_pairs'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:59:23.860894 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-830dc1b1-3194-4d9a-89f8-4ff2627397cb tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052939 Oct 14 17:59:23.861484 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 274/539] 10.222.0.27 () {62 vars in 1200 bytes} [Fri Oct 14 17:59:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 14 17:59:23.896454 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a5f3c1f2-baad-4bcf-937b-8a49a172f3d1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:23.898000 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a5f3c1f2-baad-4bcf-937b-8a49a172f3d1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:23.905332 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5f3c1f2-baad-4bcf-937b-8a49a172f3d1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:23.905826 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5f3c1f2-baad-4bcf-937b-8a49a172f3d1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:23.906262 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5f3c1f2-baad-4bcf-937b-8a49a172f3d1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:23.906955 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5f3c1f2-baad-4bcf-937b-8a49a172f3d1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:23.907406 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5f3c1f2-baad-4bcf-937b-8a49a172f3d1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:23.907827 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5f3c1f2-baad-4bcf-937b-8a49a172f3d1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:24.079855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a5f3c1f2-baad-4bcf-937b-8a49a172f3d1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:24.088956 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a5f3c1f2-baad-4bcf-937b-8a49a172f3d1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1754 microversion: 2.1 time: 0.196255 Oct 14 17:59:24.089533 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 266/540] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:23 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1754 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:25.111670 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6440ef19-9aaf-418a-90b4-f25b569fd28c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:25.112321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6440ef19-9aaf-418a-90b4-f25b569fd28c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:25.120155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6440ef19-9aaf-418a-90b4-f25b569fd28c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:25.120635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6440ef19-9aaf-418a-90b4-f25b569fd28c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:25.121070 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6440ef19-9aaf-418a-90b4-f25b569fd28c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:25.121766 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6440ef19-9aaf-418a-90b4-f25b569fd28c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:25.122217 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6440ef19-9aaf-418a-90b4-f25b569fd28c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:25.122638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6440ef19-9aaf-418a-90b4-f25b569fd28c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:25.186468 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1181032480", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e398a6f0-cbb6-41b9-a427-4e2c5e47f4f8"}], "security_groups": [{"name": "tempest-securitygroup--1355838073"}], "key_name": "tempest-keypair-1724033438", "user_data": "}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:25.291014 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6440ef19-9aaf-418a-90b4-f25b569fd28c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:25.299346 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6440ef19-9aaf-418a-90b4-f25b569fd28c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1754 microversion: 2.1 time: 0.191618 Oct 14 17:59:25.299992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 275/541] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:25 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:25.316326 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.network.neutron [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] validate_networks() for [('e398a6f0-cbb6-41b9-a427-4e2c5e47f4f8', None, None, None, None, None)] {{(pid=118656) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:59:25.680748 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Flavor limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:59:25.680958 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Image limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:59:25.681426 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Flavor pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:59:25.681824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Image pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:59:25.682257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:59:25.690932 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:25.691407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:25.691836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:25.692586 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:25.693036 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:25.693453 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:25.712155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Getting quotas for project 261d62defa42436cbcc5e712c62b76f4. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:59:25.716576 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Getting quotas for user b9187955c3cf4b77ba86e67a6f378e6a and project 261d62defa42436cbcc5e712c62b76f4. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:59:25.727969 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Going to run 1 instances... {{(pid=118656) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:59:25.730282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118656) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:59:25.783248 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-db7470db-01df-4595-9483-e9e2fbc000d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.601026 Oct 14 17:59:25.784324 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 267/542] 10.222.0.27 () {62 vars in 1188 bytes} [Fri Oct 14 17:59:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 14 17:59:25.796193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2e271670-bfd0-4b62-b3ee-0a472512d0ce tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:25.796951 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2e271670-bfd0-4b62-b3ee-0a472512d0ce tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:25.862195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2e271670-bfd0-4b62-b3ee-0a472512d0ce tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:25.871178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2e271670-bfd0-4b62-b3ee-0a472512d0ce tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:25.872666 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2e271670-bfd0-4b62-b3ee-0a472512d0ce tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:25.873766 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2e271670-bfd0-4b62-b3ee-0a472512d0ce tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1282 microversion: 2.20 time: 0.081836 Oct 14 17:59:25.874350 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 276/543] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:25 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:59:26.323573 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d253cad2-9973-482c-aff4-4b7f4bf98ae5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:26.324281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d253cad2-9973-482c-aff4-4b7f4bf98ae5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:26.333308 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d253cad2-9973-482c-aff4-4b7f4bf98ae5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:26.333792 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d253cad2-9973-482c-aff4-4b7f4bf98ae5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:26.334354 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d253cad2-9973-482c-aff4-4b7f4bf98ae5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:26.336518 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d253cad2-9973-482c-aff4-4b7f4bf98ae5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:26.336982 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d253cad2-9973-482c-aff4-4b7f4bf98ae5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:26.337585 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d253cad2-9973-482c-aff4-4b7f4bf98ae5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:26.526557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d253cad2-9973-482c-aff4-4b7f4bf98ae5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:26.540770 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d253cad2-9973-482c-aff4-4b7f4bf98ae5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1754 microversion: 2.1 time: 0.222013 Oct 14 17:59:26.541347 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 268/544] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:26 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1754 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:26.899760 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:26.900501 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:26.906898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:26.907372 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:26.907807 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:26.908545 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:26.908988 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:26.909414 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:26.976819 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:26.985620 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:26.987203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:26.988668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bf90be46-441e-43cc-9f32-83941fd448bc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1334 microversion: 2.20 time: 0.093319 Oct 14 17:59:26.989492 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 277/545] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:26 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:27.565913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b8bb9a1f-bbad-4425-b764-8b3f5cfc718c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:27.566941 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b8bb9a1f-bbad-4425-b764-8b3f5cfc718c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:27.575843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b8bb9a1f-bbad-4425-b764-8b3f5cfc718c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:27.576358 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b8bb9a1f-bbad-4425-b764-8b3f5cfc718c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:27.576793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b8bb9a1f-bbad-4425-b764-8b3f5cfc718c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:27.577614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b8bb9a1f-bbad-4425-b764-8b3f5cfc718c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:27.578102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b8bb9a1f-bbad-4425-b764-8b3f5cfc718c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:27.578854 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b8bb9a1f-bbad-4425-b764-8b3f5cfc718c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:27.837278 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b8bb9a1f-bbad-4425-b764-8b3f5cfc718c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:27.846150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b8bb9a1f-bbad-4425-b764-8b3f5cfc718c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1757 microversion: 2.1 time: 0.284792 Oct 14 17:59:27.846840 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 269/546] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:27 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1757 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:28.013839 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:28.014439 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:28.021117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:28.021591 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:28.022720 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:28.023936 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:28.024400 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:28.024817 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:28.104098 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:28.112028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:28.113458 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:28.114537 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-769ba09d-3df1-455b-ba5f-2113e774d1a3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1340 microversion: 2.20 time: 0.104634 Oct 14 17:59:28.115081 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 278/547] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:28 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1340 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:28.998673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e705b6b9-51c6-4ecd-b311-e99d47fe2406 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:29.001181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e705b6b9-51c6-4ecd-b311-e99d47fe2406 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:29.009855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e705b6b9-51c6-4ecd-b311-e99d47fe2406 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:29.010439 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e705b6b9-51c6-4ecd-b311-e99d47fe2406 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:29.010932 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e705b6b9-51c6-4ecd-b311-e99d47fe2406 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:29.011707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e705b6b9-51c6-4ecd-b311-e99d47fe2406 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:29.012925 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e705b6b9-51c6-4ecd-b311-e99d47fe2406 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:29.013452 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e705b6b9-51c6-4ecd-b311-e99d47fe2406 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:29.044972 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e705b6b9-51c6-4ecd-b311-e99d47fe2406 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050560 Oct 14 17:59:29.045529 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 270/548] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 17:59:28 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 17:59:29.125932 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d8628a31-d5a6-4bcd-8326-31893e5adeea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:29.127821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d8628a31-d5a6-4bcd-8326-31893e5adeea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:29.134728 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d8628a31-d5a6-4bcd-8326-31893e5adeea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:29.135208 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d8628a31-d5a6-4bcd-8326-31893e5adeea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:29.135631 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d8628a31-d5a6-4bcd-8326-31893e5adeea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:29.136520 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d8628a31-d5a6-4bcd-8326-31893e5adeea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:29.141537 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:29.142070 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:29.145366 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d8628a31-d5a6-4bcd-8326-31893e5adeea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:29.145736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d8628a31-d5a6-4bcd-8326-31893e5adeea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:29.157063 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:29.157551 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:29.157976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:29.158674 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:29.159120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:29.159536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:29.191024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d8628a31-d5a6-4bcd-8326-31893e5adeea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 17:59:29.284417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d8628a31-d5a6-4bcd-8326-31893e5adeea tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 204 len: 0 microversion: 2.1 time: 0.163305 Oct 14 17:59:29.285262 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 279/549] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 17:59:29 2022] DELETE /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 17:59:29.297864 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9c1e44e2-756a-4f97-80d0-1bec1bd171b1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:29.298748 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9c1e44e2-756a-4f97-80d0-1bec1bd171b1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:29.306833 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c1e44e2-756a-4f97-80d0-1bec1bd171b1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:29.307313 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c1e44e2-756a-4f97-80d0-1bec1bd171b1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:29.307742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c1e44e2-756a-4f97-80d0-1bec1bd171b1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:29.308472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c1e44e2-756a-4f97-80d0-1bec1bd171b1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:29.308899 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c1e44e2-756a-4f97-80d0-1bec1bd171b1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:29.309315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c1e44e2-756a-4f97-80d0-1bec1bd171b1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:29.434887 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:29.443317 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:29.445473 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:29.446603 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-299b6b37-b81d-4252-8a65-6acf6c7ab9a7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.308969 Oct 14 17:59:29.447152 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 271/550] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:29 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:59:29.451501 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-b9ab4e10-e31c-4110-a5c4-1d08e627ece7 req-cfe974bd-3f84-4234-817b-bd284ffafa5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc764f20-1f93-4e6d-ac1a-588f161d6ee5", "tag": "8a708001-7ad4-4eed-9fae-7d4dbab749c6"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:29.460985 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-b9ab4e10-e31c-4110-a5c4-1d08e627ece7 req-cfe974bd-3f84-4234-817b-bd284ffafa5e service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:29.461456 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-b9ab4e10-e31c-4110-a5c4-1d08e627ece7 req-cfe974bd-3f84-4234-817b-bd284ffafa5e service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:29.461884 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-b9ab4e10-e31c-4110-a5c4-1d08e627ece7 req-cfe974bd-3f84-4234-817b-bd284ffafa5e service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:29.474285 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-b9ab4e10-e31c-4110-a5c4-1d08e627ece7 req-cfe974bd-3f84-4234-817b-bd284ffafa5e service nova] Creating event network-changed:8a708001-7ad4-4eed-9fae-7d4dbab749c6 for instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 on hv-cinder-74915 Oct 14 17:59:29.479784 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-b9ab4e10-e31c-4110-a5c4-1d08e627ece7 req-cfe974bd-3f84-4234-817b-bd284ffafa5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031508 Oct 14 17:59:29.480413 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 272/551] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:29.484838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9c1e44e2-756a-4f97-80d0-1bec1bd171b1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:29.493305 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9c1e44e2-756a-4f97-80d0-1bec1bd171b1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1672 microversion: 2.1 time: 0.202554 Oct 14 17:59:29.493857 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 280/552] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:29 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1672 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:59:30.473455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:30.474080 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:30.480256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:30.480738 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:30.481170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:30.481855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:30.482308 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:30.482725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:30.516858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0aaa1127-19c2-4c9e-97b6-2c8a8c90342c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:30.517484 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0aaa1127-19c2-4c9e-97b6-2c8a8c90342c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:30.524636 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0aaa1127-19c2-4c9e-97b6-2c8a8c90342c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:30.525116 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0aaa1127-19c2-4c9e-97b6-2c8a8c90342c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:30.525547 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0aaa1127-19c2-4c9e-97b6-2c8a8c90342c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:30.526237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0aaa1127-19c2-4c9e-97b6-2c8a8c90342c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:30.526677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0aaa1127-19c2-4c9e-97b6-2c8a8c90342c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:30.527096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0aaa1127-19c2-4c9e-97b6-2c8a8c90342c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:30.659160 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:30.668114 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:30.669627 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:30.670802 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-01004dda-118f-4c6c-abd4-f8da05c37c61 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.202128 Oct 14 17:59:30.671363 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 273/553] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:30 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:30.688128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0aaa1127-19c2-4c9e-97b6-2c8a8c90342c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:30.696592 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0aaa1127-19c2-4c9e-97b6-2c8a8c90342c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1672 microversion: 2.1 time: 0.183513 Oct 14 17:59:30.697141 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 281/554] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:30 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1672 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:59:31.697134 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:31.697740 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:31.704329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:31.704814 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:31.705247 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:31.705933 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:31.706385 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:31.706805 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:31.719526 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-42e78b15-94dd-4e76-b994-311dc6265997 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:31.720148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-42e78b15-94dd-4e76-b994-311dc6265997 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:31.726548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42e78b15-94dd-4e76-b994-311dc6265997 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:31.727020 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42e78b15-94dd-4e76-b994-311dc6265997 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:31.727448 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42e78b15-94dd-4e76-b994-311dc6265997 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:31.728179 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42e78b15-94dd-4e76-b994-311dc6265997 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:31.728627 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42e78b15-94dd-4e76-b994-311dc6265997 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:31.729044 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42e78b15-94dd-4e76-b994-311dc6265997 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:31.903687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:31.907694 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-42e78b15-94dd-4e76-b994-311dc6265997 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:31.911823 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:31.913309 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:31.914396 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-095095bc-d127-433e-aaaf-1be01cc8cf86 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.221682 Oct 14 17:59:31.914947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 274/555] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:31 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:31.915324 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-42e78b15-94dd-4e76-b994-311dc6265997 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1672 microversion: 2.1 time: 0.199664 Oct 14 17:59:31.915898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 282/556] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:31 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1672 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:59:32.938486 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8285773e-961c-4696-9549-db6ee0770b85 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:32.939083 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8285773e-961c-4696-9549-db6ee0770b85 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:32.940024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:32.940634 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:32.946574 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8285773e-961c-4696-9549-db6ee0770b85 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:32.947049 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8285773e-961c-4696-9549-db6ee0770b85 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:32.947423 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:32.947539 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8285773e-961c-4696-9549-db6ee0770b85 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:32.947921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:32.948243 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8285773e-961c-4696-9549-db6ee0770b85 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:32.948413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:32.948693 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8285773e-961c-4696-9549-db6ee0770b85 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:32.949092 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:32.949189 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8285773e-961c-4696-9549-db6ee0770b85 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:32.949538 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:32.949955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:33.140074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:33.143955 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8285773e-961c-4696-9549-db6ee0770b85 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:33.148431 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:33.149888 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:33.150974 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-54cad052-f5a7-4d05-96ac-c73712ab4a20 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.214760 Oct 14 17:59:33.151526 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 283/557] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:32 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:59:33.151683 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8285773e-961c-4696-9549-db6ee0770b85 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1672 microversion: 2.1 time: 0.217024 Oct 14 17:59:33.152281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 275/558] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:32 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1672 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:34.174566 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f04827f5-b72b-43ce-bffa-56e5b7e396f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:34.175172 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f04827f5-b72b-43ce-bffa-56e5b7e396f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:34.175383 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:34.176007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:34.177597 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:34.183450 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f04827f5-b72b-43ce-bffa-56e5b7e396f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:34.183813 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:34.183948 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f04827f5-b72b-43ce-bffa-56e5b7e396f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:34.184326 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:34.184437 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f04827f5-b72b-43ce-bffa-56e5b7e396f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:34.184761 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:34.185047 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f04827f5-b72b-43ce-bffa-56e5b7e396f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:34.185452 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:34.185546 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f04827f5-b72b-43ce-bffa-56e5b7e396f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:34.185895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f04827f5-b72b-43ce-bffa-56e5b7e396f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:34.186004 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:34.186378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:34.382628 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:34.386473 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f04827f5-b72b-43ce-bffa-56e5b7e396f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:34.391193 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:34.392676 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:34.393776 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f5018697-3643-4bc8-b0de-a7fce1bdb8e4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.222147 Oct 14 17:59:34.394067 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f04827f5-b72b-43ce-bffa-56e5b7e396f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1672 microversion: 2.1 time: 0.223343 Oct 14 17:59:34.394363 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 276/559] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:34 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:59:34.394621 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 284/560] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:34 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1672 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:35.416581 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a5a78776-d79e-44bb-85e0-366cf3eb2b4a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:35.417657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a5a78776-d79e-44bb-85e0-366cf3eb2b4a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:35.418929 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:35.419539 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:35.423967 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5a78776-d79e-44bb-85e0-366cf3eb2b4a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:35.425110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5a78776-d79e-44bb-85e0-366cf3eb2b4a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:35.425611 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5a78776-d79e-44bb-85e0-366cf3eb2b4a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:35.426146 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:35.426457 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5a78776-d79e-44bb-85e0-366cf3eb2b4a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:35.426615 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:35.427053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5a78776-d79e-44bb-85e0-366cf3eb2b4a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:35.427532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a5a78776-d79e-44bb-85e0-366cf3eb2b4a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:35.427820 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:35.428536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:35.429153 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:35.429656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:35.517233 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a5a78776-d79e-44bb-85e0-366cf3eb2b4a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:35.525865 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a5a78776-d79e-44bb-85e0-366cf3eb2b4a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1605 microversion: 2.1 time: 0.112998 Oct 14 17:59:35.526507 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 277/561] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:35 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1605 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:35.603149 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:35.611181 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:35.612723 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:35.613829 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5e1226aa-fac0-4a0a-b259-86d70acbb013 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.199067 Oct 14 17:59:35.628171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 285/562] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:35 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:59:35.701540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-e7cf2a71-72e6-4e47-91a9-a20f63589392 req-a241de1c-ade5-4544-8b93-9d7528f45ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8dd3e30-1c69-471e-8b17-4205d267eb94", "name": "network-vif-deleted", "tag": "26876ea9-63aa-403a-8423-dc062a217cc1"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:35.711399 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:35.714193 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-e7cf2a71-72e6-4e47-91a9-a20f63589392 req-a241de1c-ade5-4544-8b93-9d7528f45ebb service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:35.714680 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-e7cf2a71-72e6-4e47-91a9-a20f63589392 req-a241de1c-ade5-4544-8b93-9d7528f45ebb service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:35.715278 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-e7cf2a71-72e6-4e47-91a9-a20f63589392 req-a241de1c-ade5-4544-8b93-9d7528f45ebb service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:35.733280 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=6 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:35.736560 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-e7cf2a71-72e6-4e47-91a9-a20f63589392 req-a241de1c-ade5-4544-8b93-9d7528f45ebb service nova] Creating event network-vif-deleted:26876ea9-63aa-403a-8423-dc062a217cc1 for instance c8dd3e30-1c69-471e-8b17-4205d267eb94 on hv-cinder-74915 Oct 14 17:59:35.744944 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-e7cf2a71-72e6-4e47-91a9-a20f63589392 req-a241de1c-ade5-4544-8b93-9d7528f45ebb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046922 Oct 14 17:59:35.745547 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 278/563] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:36.549141 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:36.549738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:36.551669 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:36.558700 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:36.559188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:36.559615 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:36.560353 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:36.560807 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:36.561220 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:36.593297 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:36.593773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:36.594186 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:36.594626 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lazy-loading 'fault' on Instance uuid c8dd3e30-1c69-471e-8b17-4205d267eb94 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:59:36.638712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:36.641946 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:36.643292 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:36.648837 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9f813c73-8c64-43c9-9084-ea73a548141f tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1326 microversion: 2.1 time: 0.102809 Oct 14 17:59:36.649898 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:36.655131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 286/564] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:36 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:36.657431 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:36.658853 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:36.659364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:36.660232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:36.660799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:36.661320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:36.820630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:36.828655 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:36.830080 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:36.831167 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b645a220-fb0f-4801-9c4c-34b3d87520a2 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.194120 Oct 14 17:59:36.831721 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 279/565] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:36 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:37.674295 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:37.674898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:37.681660 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:37.682136 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:37.682562 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:37.683237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:37.683681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:37.684127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:37.702461 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:37.720994 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:37.721629 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:37.722059 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:37.722499 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lazy-loading 'fault' on Instance uuid c8dd3e30-1c69-471e-8b17-4205d267eb94 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:59:37.763427 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:37.770866 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-672459ae-f0d3-4af7-b861-c7ae8b7c9856 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1326 microversion: 2.1 time: 0.100387 Oct 14 17:59:37.771414 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 287/566] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:37 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:37.857269 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:37.857872 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:37.864314 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:37.864745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:37.865181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:37.865866 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:37.866317 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:37.866737 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:37.993690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:38.001634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:38.003108 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:38.004227 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-5a33d25f-5e56-44c0-8ac5-eae308d6f7e1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.150910 Oct 14 17:59:38.004785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 280/567] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:37 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:38.796414 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:38.797019 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:38.803412 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:38.803916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:38.804591 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:38.805268 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:38.805704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:38.806115 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:38.834933 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:38.835402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:38.836346 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:38.836773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lazy-loading 'fault' on Instance uuid c8dd3e30-1c69-471e-8b17-4205d267eb94 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:59:38.880950 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:38.888649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5983cc40-9aa7-4876-b70e-94eb1937f0c1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1326 microversion: 2.1 time: 0.096637 Oct 14 17:59:38.889211 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 288/568] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:38 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:39.030027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:39.030633 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:39.036957 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:39.037443 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:39.037879 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:39.038577 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:39.039577 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:39.040033 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:39.180808 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:39.188865 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:39.190305 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:39.191401 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3574b250-da41-48e3-8517-97f5947948e5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.165246 Oct 14 17:59:39.191983 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 281/569] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:39 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:59:39.911497 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:39.912155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:39.918795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:39.919271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:39.919706 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:39.920418 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:39.920867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:39.921285 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:39.950799 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:39.951270 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:39.951697 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:39.952165 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lazy-loading 'fault' on Instance uuid c8dd3e30-1c69-471e-8b17-4205d267eb94 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:59:39.991346 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:39.998990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0fcd732d-ea85-40e5-8e2c-e791ed669978 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 200 len: 1326 microversion: 2.1 time: 0.091287 Oct 14 17:59:39.999553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 289/570] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:39 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 1326 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:40.216407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:40.217107 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:40.224088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:40.224837 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:40.225362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:40.226196 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:40.227090 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:40.227288 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:40.375048 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:40.383011 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:40.384637 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:40.385750 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1eb4a38b-bee8-432a-b509-505da2a2d352 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.173401 Oct 14 17:59:40.392418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 282/571] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:40 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:59:41.022386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:41.022848 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:41.029303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:41.029779 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:41.030206 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:41.030891 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:41.031509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:41.031948 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:41.046194 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] HTTP exception thrown: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Request method failure captured: Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 HTTP/1.1 Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaJ9BYmB5FmVpW5Kvr0Vwh6NsKmeg9VvR2SjjSv0xFUCI60wq3fIv6OcVGa2KFnFqLC485rP3iM6Ynky5vLJa1b0J_4VbvarwwKjQvXiNPwHQ3VfqWZjMNdhqZ-p7fPGlxp_pE9qJmX3zTB56EMYZCOLE3YLGMoOQ6oPQbTw2YyySaQ Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 17:59:41.047830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5488304972c48fab9a2b9711cf7e9c8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeTestJSON-994361560 Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeTestJSON-994361560-project Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 762e1e38e4234803991187db9b870b9c Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeTestJSON-994361560-project Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 17:59:41.049402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'c8dd3e30-1c69-471e-8b17-4205d267eb94'} Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 17:59:41.050212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 17:59:41.051395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 17:59:41.053193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Returning 404 to user: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 17:59:41.053193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a9f6a046-0fc0-4c43-81a5-1e73ed7478d5 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 404 len: 111 microversion: 2.1 time: 0.031112 Oct 14 17:59:41.053193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 290/572] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:41 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 17:59:41.059424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-91c71036-f79d-459c-bcf7-9929f486847e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '.version_select at 0x7fe3da539670>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:41.079975 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-91c71036-f79d-459c-bcf7-9929f486847e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-816990243" status: 202 len: 0 microversion: 2.1 time: 0.024338 Oct 14 17:59:41.080585 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 283/573] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Oct 14 17:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-816990243 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:59:41.420968 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:41.420968 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:41.423856 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:41.424568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:41.425025 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:41.425824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:41.426730 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:41.426946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:41.624761 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:41.635644 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:41.637483 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:41.638869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6777e917-1ec5-43b9-a82d-aac585039065 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.232122 Oct 14 17:59:41.639551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 291/574] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:41 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:41.810372 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4a2042a6-5731-43da-9954-a1c7c896ba41 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'create', calling method: .version_select at 0x7fe3da4a84c0>, body: {"keypair": {"name": "tempest-keypair-147499857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp1+GPWx/8kLoaOf0YcLu7EOu5LsJVVUJgcqUnFybCknh2IkWFrKdU4qkJNDzEozQdTkcmdHlKJfUvbWFZVsW9JPq9PD6NHrww2RT9EbxP3OCmfl+KN9cPIng4RFwVxLQ=="}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:41.825930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-4a2042a6-5731-43da-9954-a1c7c896ba41 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Getting quotas for project f5488304972c48fab9a2b9711cf7e9c8. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:59:41.829662 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-4a2042a6-5731-43da-9954-a1c7c896ba41 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Getting quotas for user 762e1e38e4234803991187db9b870b9c and project f5488304972c48fab9a2b9711cf7e9c8. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:59:41.852796 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4a2042a6-5731-43da-9954-a1c7c896ba41 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046704 Oct 14 17:59:41.853395 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 284/575] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Oct 14 17:59:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:42.264604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-29f46621-a774-4b36-afd0-b173784a159f req-32a3ba40-f73a-4226-9c58-72f55ab505da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc764f20-1f93-4e6d-ac1a-588f161d6ee5", "name": "network-vif-plugged", "status": "completed", "tag": "8a708001-7ad4-4eed-9fae-7d4dbab749c6"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:42.275979 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-29f46621-a774-4b36-afd0-b173784a159f req-32a3ba40-f73a-4226-9c58-72f55ab505da service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:42.276555 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-29f46621-a774-4b36-afd0-b173784a159f req-32a3ba40-f73a-4226-9c58-72f55ab505da service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:42.277072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-29f46621-a774-4b36-afd0-b173784a159f req-32a3ba40-f73a-4226-9c58-72f55ab505da service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:42.289369 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-29f46621-a774-4b36-afd0-b173784a159f req-32a3ba40-f73a-4226-9c58-72f55ab505da service nova] Creating event network-vif-plugged:8a708001-7ad4-4eed-9fae-7d4dbab749c6 for instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 on hv-cinder-74915 Oct 14 17:59:42.294419 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-29f46621-a774-4b36-afd0-b173784a159f req-32a3ba40-f73a-4226-9c58-72f55ab505da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Oct 14 17:59:42.295249 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 292/576] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:42.665671 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:42.666275 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:42.672420 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:42.672903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:42.673336 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:42.674028 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:42.674481 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:42.674899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:42.890034 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:42.898062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:42.900673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:42.901970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-aed87762-0f59-43f7-85ab-fdbeb5b124d8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.240733 Oct 14 17:59:42.902591 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 285/577] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:42 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:43.268074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-560681520", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95ca934d-e2bb-4a19-815c-bde759f0f1d5"}], "security_groups": [{"name": "tempest-securitygroup--1808248098"}], "key_name": "tempest-keypair-147499857", "user_data": "}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:43.378069 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] validate_networks() for [('95ca934d-e2bb-4a19-815c-bde759f0f1d5', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 17:59:43.748237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 17:59:43.748657 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 17:59:43.749127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 17:59:43.749530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 17:59:43.749933 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 17:59:43.758702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:43.759235 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:43.759665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:43.760415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:43.760896 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:43.761315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:43.777587 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Getting quotas for project f5488304972c48fab9a2b9711cf7e9c8. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:59:43.781468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Getting quotas for user 762e1e38e4234803991187db9b870b9c and project f5488304972c48fab9a2b9711cf7e9c8. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:59:43.792996 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 17:59:43.795330 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 17:59:43.841102 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a00c3789-81ee-4e28-98eb-bfd54b785ffd tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.577649 Oct 14 17:59:43.841893 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 293/578] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 17:59:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 17:59:43.853647 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0dde30b9-af41-4fdf-a1c6-776b9a7808d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:43.854392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0dde30b9-af41-4fdf-a1c6-776b9a7808d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:43.917193 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0dde30b9-af41-4fdf-a1c6-776b9a7808d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:43.927825 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0dde30b9-af41-4fdf-a1c6-776b9a7808d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1236 microversion: 2.1 time: 0.078882 Oct 14 17:59:43.928580 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:43.929181 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:43.929321 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 286/579] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:43 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:43.937976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:43.938799 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:43.939312 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:43.940754 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:43.941247 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:43.941662 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:44.086269 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:44.095763 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:44.097257 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:44.098545 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a1bf7b75-b5ac-4f67-aa2f-1686694d1729 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1408 microversion: 2.20 time: 0.174315 Oct 14 17:59:44.099456 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 294/580] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:43 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 17:59:44.950974 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1728858c-bd6e-43d0-9b9f-659f2e8740f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:44.951702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1728858c-bd6e-43d0-9b9f-659f2e8740f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:44.959300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1728858c-bd6e-43d0-9b9f-659f2e8740f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:44.959761 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1728858c-bd6e-43d0-9b9f-659f2e8740f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:44.960232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1728858c-bd6e-43d0-9b9f-659f2e8740f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:44.961308 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1728858c-bd6e-43d0-9b9f-659f2e8740f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:44.961799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1728858c-bd6e-43d0-9b9f-659f2e8740f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:44.962240 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1728858c-bd6e-43d0-9b9f-659f2e8740f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:44.980134 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=100 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:45.033719 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1728858c-bd6e-43d0-9b9f-659f2e8740f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:45.043143 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1728858c-bd6e-43d0-9b9f-659f2e8740f1 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1288 microversion: 2.1 time: 0.095419 Oct 14 17:59:45.044191 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 287/581] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:44 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:45.130812 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:45.132521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:45.143070 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:45.143822 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:45.145266 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:45.146673 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:45.148706 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:45.149469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:45.361079 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:45.369309 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:45.370745 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:45.371908 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-dc8018b3-2a3a-48bb-a82d-dae4c4c66a67 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1600 microversion: 2.20 time: 0.249138 Oct 14 17:59:45.372451 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 295/582] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 17:59:45 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1600 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 17:59:45.396918 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-764a6fef-cce9-4bfe-9e15-6636bc6bcd8a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:45.397651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-764a6fef-cce9-4bfe-9e15-6636bc6bcd8a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:45.404243 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-764a6fef-cce9-4bfe-9e15-6636bc6bcd8a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:45.404728 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-764a6fef-cce9-4bfe-9e15-6636bc6bcd8a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:45.405490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-764a6fef-cce9-4bfe-9e15-6636bc6bcd8a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:45.405879 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-764a6fef-cce9-4bfe-9e15-6636bc6bcd8a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:45.406454 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-764a6fef-cce9-4bfe-9e15-6636bc6bcd8a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:45.406878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-764a6fef-cce9-4bfe-9e15-6636bc6bcd8a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:45.530559 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-764a6fef-cce9-4bfe-9e15-6636bc6bcd8a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.137526 Oct 14 17:59:45.531234 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 288/583] 10.222.0.27 () {60 vars in 1316 bytes} [Fri Oct 14 17:59:45 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 17:59:46.067867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b3f93699-6619-4f49-82dd-f317edc33cba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:46.068510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b3f93699-6619-4f49-82dd-f317edc33cba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:46.076176 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3f93699-6619-4f49-82dd-f317edc33cba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:46.077306 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3f93699-6619-4f49-82dd-f317edc33cba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:46.077750 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3f93699-6619-4f49-82dd-f317edc33cba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:46.078447 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3f93699-6619-4f49-82dd-f317edc33cba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:46.078902 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3f93699-6619-4f49-82dd-f317edc33cba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:46.079321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3f93699-6619-4f49-82dd-f317edc33cba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:46.324886 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b3f93699-6619-4f49-82dd-f317edc33cba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:46.335664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b3f93699-6619-4f49-82dd-f317edc33cba tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1362 microversion: 2.1 time: 0.271803 Oct 14 17:59:46.337970 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 296/584] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:46 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:46.565606 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-30d55d46-7bb0-4226-a202-50cdea4d5016 req-cade326e-59eb-482a-a0dc-48767a66b095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc764f20-1f93-4e6d-ac1a-588f161d6ee5", "tag": "8a708001-7ad4-4eed-9fae-7d4dbab749c6"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:46.578644 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-30d55d46-7bb0-4226-a202-50cdea4d5016 req-cade326e-59eb-482a-a0dc-48767a66b095 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:46.579486 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-30d55d46-7bb0-4226-a202-50cdea4d5016 req-cade326e-59eb-482a-a0dc-48767a66b095 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:46.580220 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-30d55d46-7bb0-4226-a202-50cdea4d5016 req-cade326e-59eb-482a-a0dc-48767a66b095 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:46.594131 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-30d55d46-7bb0-4226-a202-50cdea4d5016 req-cade326e-59eb-482a-a0dc-48767a66b095 service nova] Creating event network-changed:8a708001-7ad4-4eed-9fae-7d4dbab749c6 for instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 on hv-cinder-74915 Oct 14 17:59:46.601296 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-30d55d46-7bb0-4226-a202-50cdea4d5016 req-cade326e-59eb-482a-a0dc-48767a66b095 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040735 Oct 14 17:59:46.603444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 289/585] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:46.983633 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-f0e3a7a0-6e4e-4ded-8e1c-23d0cd1364c5 req-83fd8055-18c7-467c-8838-3daeeae9914c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "557fb52b-468d-475a-a26d-71d7975ef533", "tag": "6f1cafbd-d8fe-433d-83bd-3cccddfa6e16"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:46.999759 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-f0e3a7a0-6e4e-4ded-8e1c-23d0cd1364c5 req-83fd8055-18c7-467c-8838-3daeeae9914c service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:47.006404 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-f0e3a7a0-6e4e-4ded-8e1c-23d0cd1364c5 req-83fd8055-18c7-467c-8838-3daeeae9914c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:47.006933 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-f0e3a7a0-6e4e-4ded-8e1c-23d0cd1364c5 req-83fd8055-18c7-467c-8838-3daeeae9914c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:47.046972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-f0e3a7a0-6e4e-4ded-8e1c-23d0cd1364c5 req-83fd8055-18c7-467c-8838-3daeeae9914c service nova] Creating event network-changed:6f1cafbd-d8fe-433d-83bd-3cccddfa6e16 for instance 557fb52b-468d-475a-a26d-71d7975ef533 on hv-cinder-74915 Oct 14 17:59:47.053571 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-f0e3a7a0-6e4e-4ded-8e1c-23d0cd1364c5 req-83fd8055-18c7-467c-8838-3daeeae9914c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073255 Oct 14 17:59:47.055708 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 297/586] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:47.364401 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-cfc1dc63-2d28-48a6-8884-1913db081e0d tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:47.365107 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-cfc1dc63-2d28-48a6-8884-1913db081e0d tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:47.375267 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cfc1dc63-2d28-48a6-8884-1913db081e0d tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:47.376032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cfc1dc63-2d28-48a6-8884-1913db081e0d tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:47.376651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cfc1dc63-2d28-48a6-8884-1913db081e0d tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:47.377531 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cfc1dc63-2d28-48a6-8884-1913db081e0d tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:47.378666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cfc1dc63-2d28-48a6-8884-1913db081e0d tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:47.379255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-cfc1dc63-2d28-48a6-8884-1913db081e0d tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:47.593674 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-cfc1dc63-2d28-48a6-8884-1913db081e0d tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:47.601714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-cfc1dc63-2d28-48a6-8884-1913db081e0d tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1362 microversion: 2.1 time: 0.241402 Oct 14 17:59:47.602411 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 290/587] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:47 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:48.626441 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8308112e-3215-4424-9459-5352f72c1d94 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:48.627245 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8308112e-3215-4424-9459-5352f72c1d94 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:48.634055 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8308112e-3215-4424-9459-5352f72c1d94 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:48.634544 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8308112e-3215-4424-9459-5352f72c1d94 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:48.635050 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8308112e-3215-4424-9459-5352f72c1d94 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:48.635840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8308112e-3215-4424-9459-5352f72c1d94 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:48.636385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8308112e-3215-4424-9459-5352f72c1d94 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:48.636873 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8308112e-3215-4424-9459-5352f72c1d94 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:48.941454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8308112e-3215-4424-9459-5352f72c1d94 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:48.949509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8308112e-3215-4424-9459-5352f72c1d94 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1362 microversion: 2.1 time: 0.327748 Oct 14 17:59:48.950082 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 298/588] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:48 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:49.972523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-38479fbb-da01-44e5-8375-28b865c27371 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:49.973300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-38479fbb-da01-44e5-8375-28b865c27371 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:49.981830 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38479fbb-da01-44e5-8375-28b865c27371 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:49.982358 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38479fbb-da01-44e5-8375-28b865c27371 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:49.982885 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38479fbb-da01-44e5-8375-28b865c27371 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:49.983613 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38479fbb-da01-44e5-8375-28b865c27371 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:49.984131 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38479fbb-da01-44e5-8375-28b865c27371 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:49.984617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-38479fbb-da01-44e5-8375-28b865c27371 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:50.154435 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-38479fbb-da01-44e5-8375-28b865c27371 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:50.163101 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-38479fbb-da01-44e5-8375-28b865c27371 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1362 microversion: 2.1 time: 0.194499 Oct 14 17:59:50.165111 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 291/589] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:49 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:51.191051 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-944a2343-2f57-4050-ae74-7e03e596d6cc tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:51.192322 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-944a2343-2f57-4050-ae74-7e03e596d6cc tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:51.199663 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-944a2343-2f57-4050-ae74-7e03e596d6cc tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:51.200542 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-944a2343-2f57-4050-ae74-7e03e596d6cc tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:51.201318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-944a2343-2f57-4050-ae74-7e03e596d6cc tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:51.202190 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-944a2343-2f57-4050-ae74-7e03e596d6cc tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:51.202803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-944a2343-2f57-4050-ae74-7e03e596d6cc tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:51.203216 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-944a2343-2f57-4050-ae74-7e03e596d6cc tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:51.514246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-944a2343-2f57-4050-ae74-7e03e596d6cc tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:51.522140 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-944a2343-2f57-4050-ae74-7e03e596d6cc tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1362 microversion: 2.1 time: 0.334587 Oct 14 17:59:51.522909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 299/590] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:51 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:59:52.152080 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d51b3305-5c8b-4377-a183-131501e08c3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:52.153177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d51b3305-5c8b-4377-a183-131501e08c3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:52.161537 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d51b3305-5c8b-4377-a183-131501e08c3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:52.162374 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d51b3305-5c8b-4377-a183-131501e08c3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:52.163133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d51b3305-5c8b-4377-a183-131501e08c3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:52.164680 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d51b3305-5c8b-4377-a183-131501e08c3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:52.165362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d51b3305-5c8b-4377-a183-131501e08c3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:52.165999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d51b3305-5c8b-4377-a183-131501e08c3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:52.301412 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-d51b3305-5c8b-4377-a183-131501e08c3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lazy-loading 'services' on Instance uuid b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 17:59:52.427436 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d51b3305-5c8b-4377-a183-131501e08c3c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments/291db3a3-6c96-4d22-af22-a9787f475274" status: 202 len: 0 microversion: 2.1 time: 0.281967 Oct 14 17:59:52.433096 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 292/591] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 17:59:52 2022] DELETE /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments/291db3a3-6c96-4d22-af22-a9787f475274 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 17:59:52.444919 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-273295ed-2644-42a6-8b2d-f28fe84ee832 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:52.447871 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-273295ed-2644-42a6-8b2d-f28fe84ee832 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:52.462409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-273295ed-2644-42a6-8b2d-f28fe84ee832 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:52.469307 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-273295ed-2644-42a6-8b2d-f28fe84ee832 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:52.469762 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-273295ed-2644-42a6-8b2d-f28fe84ee832 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:52.470510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-273295ed-2644-42a6-8b2d-f28fe84ee832 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:52.470964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-273295ed-2644-42a6-8b2d-f28fe84ee832 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:52.471385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-273295ed-2644-42a6-8b2d-f28fe84ee832 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:52.527807 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-273295ed-2644-42a6-8b2d-f28fe84ee832 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094542 Oct 14 17:59:52.528899 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 300/592] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 17:59:52 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 17:59:52.539376 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-d3b63589-a35e-43aa-b36b-5f103ed513dd req-35a3c7f0-99d6-45b2-873a-c129f998597d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "557fb52b-468d-475a-a26d-71d7975ef533", "name": "network-vif-plugged", "status": "completed", "tag": "6f1cafbd-d8fe-433d-83bd-3cccddfa6e16"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:52.551907 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-d3b63589-a35e-43aa-b36b-5f103ed513dd req-35a3c7f0-99d6-45b2-873a-c129f998597d service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:52.552170 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d16ab7fd-d4f4-49cc-8781-dc6c84c45843 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:52.552791 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-d3b63589-a35e-43aa-b36b-5f103ed513dd req-35a3c7f0-99d6-45b2-873a-c129f998597d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:52.552942 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d16ab7fd-d4f4-49cc-8781-dc6c84c45843 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:52.553604 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-d3b63589-a35e-43aa-b36b-5f103ed513dd req-35a3c7f0-99d6-45b2-873a-c129f998597d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:52.569117 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-d3b63589-a35e-43aa-b36b-5f103ed513dd req-35a3c7f0-99d6-45b2-873a-c129f998597d service nova] Creating event network-vif-plugged:6f1cafbd-d8fe-433d-83bd-3cccddfa6e16 for instance 557fb52b-468d-475a-a26d-71d7975ef533 on hv-cinder-74915 Oct 14 17:59:52.569667 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d16ab7fd-d4f4-49cc-8781-dc6c84c45843 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:52.571547 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d16ab7fd-d4f4-49cc-8781-dc6c84c45843 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:52.574382 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d16ab7fd-d4f4-49cc-8781-dc6c84c45843 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:52.575485 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d16ab7fd-d4f4-49cc-8781-dc6c84c45843 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:52.576408 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d16ab7fd-d4f4-49cc-8781-dc6c84c45843 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:52.576717 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-d3b63589-a35e-43aa-b36b-5f103ed513dd req-35a3c7f0-99d6-45b2-873a-c129f998597d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041575 Oct 14 17:59:52.577286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d16ab7fd-d4f4-49cc-8781-dc6c84c45843 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:52.578120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 293/593] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:52.900646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d16ab7fd-d4f4-49cc-8781-dc6c84c45843 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:52.908794 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d16ab7fd-d4f4-49cc-8781-dc6c84c45843 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1362 microversion: 2.1 time: 0.365781 Oct 14 17:59:52.909514 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 301/594] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:52 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:53.544974 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-846bcc4e-114d-487e-b11b-3a5cef0d7d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:53.548043 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-846bcc4e-114d-487e-b11b-3a5cef0d7d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:53.559788 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-846bcc4e-114d-487e-b11b-3a5cef0d7d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:53.560316 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-846bcc4e-114d-487e-b11b-3a5cef0d7d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:53.560755 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-846bcc4e-114d-487e-b11b-3a5cef0d7d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:53.561464 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-846bcc4e-114d-487e-b11b-3a5cef0d7d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:53.561915 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-846bcc4e-114d-487e-b11b-3a5cef0d7d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:53.562340 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-846bcc4e-114d-487e-b11b-3a5cef0d7d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:53.593753 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-846bcc4e-114d-487e-b11b-3a5cef0d7d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056812 Oct 14 17:59:53.594327 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 294/595] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 17:59:53 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 17:59:53.678811 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b5d84b13-ac0b-426f-87ab-77673bff82b4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:53.679707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b5d84b13-ac0b-426f-87ab-77673bff82b4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:53.686484 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b5d84b13-ac0b-426f-87ab-77673bff82b4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:53.686961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b5d84b13-ac0b-426f-87ab-77673bff82b4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:53.687389 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b5d84b13-ac0b-426f-87ab-77673bff82b4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:53.688102 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b5d84b13-ac0b-426f-87ab-77673bff82b4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:53.688556 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b5d84b13-ac0b-426f-87ab-77673bff82b4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:53.688963 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b5d84b13-ac0b-426f-87ab-77673bff82b4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:53.718697 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b5d84b13-ac0b-426f-87ab-77673bff82b4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 17:59:53.768500 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:53.787467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:53.803771 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b5d84b13-ac0b-426f-87ab-77673bff82b4 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 204 len: 0 microversion: 2.1 time: 0.129876 Oct 14 17:59:53.804407 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 302/596] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 17:59:53 2022] DELETE /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 17:59:53.813824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-17af5084-adf4-4dbf-b5ce-bc59ab8f9ea7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:53.814434 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-17af5084-adf4-4dbf-b5ce-bc59ab8f9ea7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:53.820815 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17af5084-adf4-4dbf-b5ce-bc59ab8f9ea7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:53.821317 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17af5084-adf4-4dbf-b5ce-bc59ab8f9ea7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:53.821748 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17af5084-adf4-4dbf-b5ce-bc59ab8f9ea7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:53.822446 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17af5084-adf4-4dbf-b5ce-bc59ab8f9ea7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:53.822902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17af5084-adf4-4dbf-b5ce-bc59ab8f9ea7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:53.823326 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17af5084-adf4-4dbf-b5ce-bc59ab8f9ea7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:53.924724 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=6 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:53.934625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c8e42867-bdda-438a-8e69-1b16294040e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:53.935342 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c8e42867-bdda-438a-8e69-1b16294040e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:53.942685 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e42867-bdda-438a-8e69-1b16294040e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:53.943199 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e42867-bdda-438a-8e69-1b16294040e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:53.943638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e42867-bdda-438a-8e69-1b16294040e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:53.944426 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e42867-bdda-438a-8e69-1b16294040e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:53.944908 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e42867-bdda-438a-8e69-1b16294040e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:53.946320 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e42867-bdda-438a-8e69-1b16294040e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:54.098023 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-17af5084-adf4-4dbf-b5ce-bc59ab8f9ea7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:54.106553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-17af5084-adf4-4dbf-b5ce-bc59ab8f9ea7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1690 microversion: 2.1 time: 0.296706 Oct 14 17:59:54.107145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 295/597] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:53 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1690 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:59:54.210526 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c8e42867-bdda-438a-8e69-1b16294040e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:54.221522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c8e42867-bdda-438a-8e69-1b16294040e3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1362 microversion: 2.1 time: 0.292330 Oct 14 17:59:54.224635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 303/598] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:53 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:55.132104 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1a0391ae-fedb-468a-b107-99980d4c0aef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:55.132693 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1a0391ae-fedb-468a-b107-99980d4c0aef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:55.139996 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a0391ae-fedb-468a-b107-99980d4c0aef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:55.140596 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a0391ae-fedb-468a-b107-99980d4c0aef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:55.141262 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a0391ae-fedb-468a-b107-99980d4c0aef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:55.142190 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a0391ae-fedb-468a-b107-99980d4c0aef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:55.142736 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a0391ae-fedb-468a-b107-99980d4c0aef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:55.143214 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a0391ae-fedb-468a-b107-99980d4c0aef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:55.252764 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-fb581876-8dba-4c4d-8557-bdd81b1e0f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:55.254176 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-fb581876-8dba-4c4d-8557-bdd81b1e0f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:55.261561 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb581876-8dba-4c4d-8557-bdd81b1e0f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:55.262269 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb581876-8dba-4c4d-8557-bdd81b1e0f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:55.262804 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb581876-8dba-4c4d-8557-bdd81b1e0f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:55.264400 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb581876-8dba-4c4d-8557-bdd81b1e0f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:55.265008 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb581876-8dba-4c4d-8557-bdd81b1e0f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:55.265706 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fb581876-8dba-4c4d-8557-bdd81b1e0f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:55.271037 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:55.488542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1a0391ae-fedb-468a-b107-99980d4c0aef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:55.497586 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1a0391ae-fedb-468a-b107-99980d4c0aef tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1690 microversion: 2.1 time: 0.369586 Oct 14 17:59:55.498161 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 296/599] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:55 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1690 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:55.552041 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-fb581876-8dba-4c4d-8557-bdd81b1e0f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:55.561040 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-fb581876-8dba-4c4d-8557-bdd81b1e0f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1362 microversion: 2.1 time: 0.312504 Oct 14 17:59:55.561769 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 304/600] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:55 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:56.522447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-327c6558-7443-4af5-8444-bfe2f4a0e354 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:56.524256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-327c6558-7443-4af5-8444-bfe2f4a0e354 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:56.531359 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-327c6558-7443-4af5-8444-bfe2f4a0e354 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:56.532120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-327c6558-7443-4af5-8444-bfe2f4a0e354 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:56.532766 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-327c6558-7443-4af5-8444-bfe2f4a0e354 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:56.533678 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-327c6558-7443-4af5-8444-bfe2f4a0e354 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:56.534483 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-327c6558-7443-4af5-8444-bfe2f4a0e354 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:56.535071 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-327c6558-7443-4af5-8444-bfe2f4a0e354 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:56.585898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-128ec58e-9793-4eeb-a989-fd44e218f041 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:56.587319 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-128ec58e-9793-4eeb-a989-fd44e218f041 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:56.597122 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-128ec58e-9793-4eeb-a989-fd44e218f041 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:56.598658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-128ec58e-9793-4eeb-a989-fd44e218f041 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:56.600219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-128ec58e-9793-4eeb-a989-fd44e218f041 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:56.608976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-128ec58e-9793-4eeb-a989-fd44e218f041 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:56.609473 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-128ec58e-9793-4eeb-a989-fd44e218f041 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:56.609905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-128ec58e-9793-4eeb-a989-fd44e218f041 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:56.761289 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-327c6558-7443-4af5-8444-bfe2f4a0e354 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:56.770954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-327c6558-7443-4af5-8444-bfe2f4a0e354 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1690 microversion: 2.1 time: 0.252223 Oct 14 17:59:56.771542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 297/601] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:56 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1690 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:56.858684 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-128ec58e-9793-4eeb-a989-fd44e218f041 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:56.880410 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-128ec58e-9793-4eeb-a989-fd44e218f041 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1362 microversion: 2.1 time: 0.298171 Oct 14 17:59:56.881797 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 305/602] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:56 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:57.796247 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-016c83f4-ff19-458f-9143-8707ffc2916f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:57.796868 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-016c83f4-ff19-458f-9143-8707ffc2916f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:57.812148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-016c83f4-ff19-458f-9143-8707ffc2916f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:57.812578 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-016c83f4-ff19-458f-9143-8707ffc2916f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:57.813019 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-016c83f4-ff19-458f-9143-8707ffc2916f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:57.813768 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-016c83f4-ff19-458f-9143-8707ffc2916f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:57.814222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-016c83f4-ff19-458f-9143-8707ffc2916f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:57.814648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-016c83f4-ff19-458f-9143-8707ffc2916f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:57.905318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bf202139-6b5c-46f4-9308-93a86bf1a106 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:57.907143 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bf202139-6b5c-46f4-9308-93a86bf1a106 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:57.933184 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf202139-6b5c-46f4-9308-93a86bf1a106 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:57.934219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf202139-6b5c-46f4-9308-93a86bf1a106 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:57.934673 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf202139-6b5c-46f4-9308-93a86bf1a106 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:57.935420 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf202139-6b5c-46f4-9308-93a86bf1a106 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:57.935867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf202139-6b5c-46f4-9308-93a86bf1a106 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:57.938666 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf202139-6b5c-46f4-9308-93a86bf1a106 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:58.112943 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-016c83f4-ff19-458f-9143-8707ffc2916f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:58.123319 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-016c83f4-ff19-458f-9143-8707ffc2916f tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1690 microversion: 2.1 time: 0.331284 Oct 14 17:59:58.124701 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 298/603] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:57 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1690 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:58.174038 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bf202139-6b5c-46f4-9308-93a86bf1a106 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:58.183399 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bf202139-6b5c-46f4-9308-93a86bf1a106 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1549 microversion: 2.1 time: 0.282314 Oct 14 17:59:58.184406 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 306/604] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:57 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1549 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 17:59:58.212333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-47c66c43-d6d9-4878-8b7d-d21482140f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:58.226503 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-47c66c43-d6d9-4878-8b7d-d21482140f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:58.248986 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-47c66c43-d6d9-4878-8b7d-d21482140f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:58.251391 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-47c66c43-d6d9-4878-8b7d-d21482140f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:58.251822 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-47c66c43-d6d9-4878-8b7d-d21482140f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:58.254075 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-47c66c43-d6d9-4878-8b7d-d21482140f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:58.254561 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-47c66c43-d6d9-4878-8b7d-d21482140f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:58.254989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-47c66c43-d6d9-4878-8b7d-d21482140f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:58.413731 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-47c66c43-d6d9-4878-8b7d-d21482140f58 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205423 Oct 14 17:59:58.415290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 299/605] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Oct 14 17:59:58 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:59.159572 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3e14d54a-fdb7-4d76-a7ca-b517037428f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 17:59:59.162113 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3e14d54a-fdb7-4d76-a7ca-b517037428f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 17:59:59.177993 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e14d54a-fdb7-4d76-a7ca-b517037428f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:59.187410 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e14d54a-fdb7-4d76-a7ca-b517037428f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:59.188331 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e14d54a-fdb7-4d76-a7ca-b517037428f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:59.191431 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e14d54a-fdb7-4d76-a7ca-b517037428f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:59.192308 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e14d54a-fdb7-4d76-a7ca-b517037428f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:59.193419 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e14d54a-fdb7-4d76-a7ca-b517037428f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:59.306441 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3e14d54a-fdb7-4d76-a7ca-b517037428f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 17:59:59.315687 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3e14d54a-fdb7-4d76-a7ca-b517037428f7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1622 microversion: 2.1 time: 0.169124 Oct 14 17:59:59.315687 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 307/606] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 17:59:59 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1622 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 17:59:59.635510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-48e2ea9c-c952-492b-bd07-0ead02ee0f61 req-99a67b2d-3cfd-4c8c-9ee7-8cadd8874b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5", "name": "network-vif-deleted", "tag": "6276aa8e-78da-45f2-9027-e54c0e8353b7"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:59.651842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-48e2ea9c-c952-492b-bd07-0ead02ee0f61 req-99a67b2d-3cfd-4c8c-9ee7-8cadd8874b5f service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 17:59:59.652599 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-48e2ea9c-c952-492b-bd07-0ead02ee0f61 req-99a67b2d-3cfd-4c8c-9ee7-8cadd8874b5f service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 17:59:59.653183 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-48e2ea9c-c952-492b-bd07-0ead02ee0f61 req-99a67b2d-3cfd-4c8c-9ee7-8cadd8874b5f service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 17:59:59.681914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-48e2ea9c-c952-492b-bd07-0ead02ee0f61 req-99a67b2d-3cfd-4c8c-9ee7-8cadd8874b5f service nova] Creating event network-vif-deleted:6276aa8e-78da-45f2-9027-e54c0e8353b7 for instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 on hv-cinder-74915 Oct 14 17:59:59.689633 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-48e2ea9c-c952-492b-bd07-0ead02ee0f61 req-99a67b2d-3cfd-4c8c-9ee7-8cadd8874b5f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074641 Oct 14 17:59:59.690828 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 308/607] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 17:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 17:59:59.870169 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-af5c3db0-2b43-4c61-8ba6-d15b1d3692ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Action: 'create', calling method: .version_select at 0x7fe3da50a790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-941379814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYy6Lh35KL84M3StKBlc6zRI7ptMtXnXBbn9fYdDuYGXwuSRbZcptQZl3gmD2mSeSdR4mF+iE5cdB0C7ADjmslXx5Ajuv7T+smQ3Ak0U+WI5x6iT/Yq7j6Zj/O2TJWokQ=="}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 17:59:59.889026 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-af5c3db0-2b43-4c61-8ba6-d15b1d3692ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Getting quotas for project 87b79c338b0047dfb68e9a5b9b16c51b. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 17:59:59.893546 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-af5c3db0-2b43-4c61-8ba6-d15b1d3692ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Getting quotas for user 072cedf1a6a24f6fa7d7ed92981344dd and project 87b79c338b0047dfb68e9a5b9b16c51b. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 17:59:59.929531 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-af5c3db0-2b43-4c61-8ba6-d15b1d3692ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.407490 Oct 14 17:59:59.931788 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 300/608] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Oct 14 17:59:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:00.340355 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:00.341165 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:00.351375 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:00.353654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:00.374973 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:00.377192 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:00.378835 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:00.381392 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:00.482534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-2abd4f60-f4ee-4013-b32d-a248f312b31a req-83d6946d-969d-49a3-a5dc-b0508c2e21b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "557fb52b-468d-475a-a26d-71d7975ef533", "tag": "6f1cafbd-d8fe-433d-83bd-3cccddfa6e16"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:00.496361 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:00.496987 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:00.497512 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:00.508658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lazy-loading 'fault' on Instance uuid b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:00:00.520775 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-2abd4f60-f4ee-4013-b32d-a248f312b31a req-83d6946d-969d-49a3-a5dc-b0508c2e21b9 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:00.521325 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-2abd4f60-f4ee-4013-b32d-a248f312b31a req-83d6946d-969d-49a3-a5dc-b0508c2e21b9 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:00.521773 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-2abd4f60-f4ee-4013-b32d-a248f312b31a req-83d6946d-969d-49a3-a5dc-b0508c2e21b9 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:00.535104 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-2abd4f60-f4ee-4013-b32d-a248f312b31a req-83d6946d-969d-49a3-a5dc-b0508c2e21b9 service nova] Creating event network-changed:6f1cafbd-d8fe-433d-83bd-3cccddfa6e16 for instance 557fb52b-468d-475a-a26d-71d7975ef533 on hv-cinder-74915 Oct 14 18:00:00.545231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-2abd4f60-f4ee-4013-b32d-a248f312b31a req-83d6946d-969d-49a3-a5dc-b0508c2e21b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066691 Oct 14 18:00:00.546226 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 301/609] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:00.566952 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:00.584275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-81311218-a227-4202-bc8e-e7a729f292d6 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 200 len: 1335 microversion: 2.1 time: 0.242859 Oct 14 18:00:00.585392 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 309/610] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:00 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 1335 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:01.613511 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:01.614425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:01.620705 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:01.621267 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:01.621945 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:01.622870 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:01.623624 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:01.624179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:01.646248 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] HTTP exception thrown: Instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 could not be found. Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Request method failure captured: Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 HTTP/1.1 Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaKDmRrof5YHVAQuXH5mCmDyChagswaliw2J6djtI1m1MzfFbX_OeNHyKd6c1qH-kQE6f6YepZsCS80ByX10HmAJEJ4z6UGwvEVyJkW_2zz4EnwAkiavkywX7UaHyl4vi6r80kNDj3tqM4-o-KGZziEuY7SpETnctapai-BZfnW-4co Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 530fdfc3448a40b7aa85170873d3f0ff Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:00:01.647843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_530fdfc3448a40b7aa85170873d3f0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 530fdfc3448a40b7aa85170873d3f0ff Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-ServerRescueNegativeTestJSON-155189197-project Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: c091bf027839447da4c713deb291ed1f Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-ServerRescueNegativeTestJSON-155189197-project Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 could not be found. Oct 14 18:00:01.650144 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5'} Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 could not be found. Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:00:01.651027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 could not be found. Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 could not be found. Oct 14 18:00:01.652508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:01.660700 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Returning 404 to user: Instance b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:00:01.661442 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3e368e63-faf4-4206-a745-fa89aff94bc8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5" status: 404 len: 111 microversion: 2.1 time: 0.052870 Oct 14 18:00:01.662015 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 302/611] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:01 2022] GET /compute/v2.1/servers/b8e5bbce-1033-41d8-8b6f-bf34eed3a8b5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:00:01.671808 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-96013d47-08bc-45dc-8683-72467ace293c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '.version_select at 0x7fe3da80df70>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:01.707654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-96013d47-08bc-45dc-8683-72467ace293c tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946230769" status: 202 len: 0 microversion: 2.1 time: 0.040301 Oct 14 18:00:01.713433 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 310/612] 10.222.0.27 () {58 vars in 1221 bytes} [Fri Oct 14 18:00:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946230769 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:00:04.783094 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-385ee5a4-47f6-4109-92c7-e1dbe3de0f2d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:04.783590 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-385ee5a4-47f6-4109-92c7-e1dbe3de0f2d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:04.790003 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-385ee5a4-47f6-4109-92c7-e1dbe3de0f2d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:04.790483 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-385ee5a4-47f6-4109-92c7-e1dbe3de0f2d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:04.791805 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-385ee5a4-47f6-4109-92c7-e1dbe3de0f2d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:04.792265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-385ee5a4-47f6-4109-92c7-e1dbe3de0f2d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:04.792719 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-385ee5a4-47f6-4109-92c7-e1dbe3de0f2d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:04.793143 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-385ee5a4-47f6-4109-92c7-e1dbe3de0f2d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:04.818594 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-385ee5a4-47f6-4109-92c7-e1dbe3de0f2d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Going to try to terminate instance {{(pid=118656) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:00:04.893635 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-385ee5a4-47f6-4109-92c7-e1dbe3de0f2d tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 204 len: 0 microversion: 2.1 time: 0.114043 Oct 14 18:00:04.894222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 303/613] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:00:04 2022] DELETE /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:00:04.903767 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-13f681a2-4c53-46a8-8def-8558e82e53a1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:04.904399 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-13f681a2-4c53-46a8-8def-8558e82e53a1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:04.906275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:04.912156 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13f681a2-4c53-46a8-8def-8558e82e53a1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:04.912670 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13f681a2-4c53-46a8-8def-8558e82e53a1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:04.913100 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13f681a2-4c53-46a8-8def-8558e82e53a1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:04.913788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13f681a2-4c53-46a8-8def-8558e82e53a1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:04.914237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13f681a2-4c53-46a8-8def-8558e82e53a1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:04.914654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13f681a2-4c53-46a8-8def-8558e82e53a1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:05.164249 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-13f681a2-4c53-46a8-8def-8558e82e53a1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:05.172814 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-13f681a2-4c53-46a8-8def-8558e82e53a1 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1507 microversion: 2.1 time: 0.273984 Oct 14 18:00:05.173366 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 311/614] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:04 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:06.197218 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7803c525-67a1-45c6-9cab-6db76edb0391 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:06.197939 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7803c525-67a1-45c6-9cab-6db76edb0391 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:06.205151 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7803c525-67a1-45c6-9cab-6db76edb0391 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:06.205631 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7803c525-67a1-45c6-9cab-6db76edb0391 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:06.206431 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7803c525-67a1-45c6-9cab-6db76edb0391 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:06.206721 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7803c525-67a1-45c6-9cab-6db76edb0391 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:06.207166 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7803c525-67a1-45c6-9cab-6db76edb0391 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:06.207580 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7803c525-67a1-45c6-9cab-6db76edb0391 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:06.402918 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7803c525-67a1-45c6-9cab-6db76edb0391 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:06.411708 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7803c525-67a1-45c6-9cab-6db76edb0391 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1507 microversion: 2.1 time: 0.218601 Oct 14 18:00:06.412330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 304/615] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:06 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:07.434925 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-94b14fcc-e668-4d2b-873f-f6fb9fc53d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:07.435525 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-94b14fcc-e668-4d2b-873f-f6fb9fc53d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:07.441858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94b14fcc-e668-4d2b-873f-f6fb9fc53d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:07.442501 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94b14fcc-e668-4d2b-873f-f6fb9fc53d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:07.442846 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94b14fcc-e668-4d2b-873f-f6fb9fc53d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:07.443577 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94b14fcc-e668-4d2b-873f-f6fb9fc53d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:07.444049 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94b14fcc-e668-4d2b-873f-f6fb9fc53d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:07.444472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-94b14fcc-e668-4d2b-873f-f6fb9fc53d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:07.615519 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-94b14fcc-e668-4d2b-873f-f6fb9fc53d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:07.623804 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-94b14fcc-e668-4d2b-873f-f6fb9fc53d0b tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1507 microversion: 2.1 time: 0.193075 Oct 14 18:00:07.624420 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 312/616] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:07 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:08.029366 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-42e22cf6-4750-47d7-8656-b80f2a5843b8 req-1ae68a43-ab99-4164-8fbe-76199e2c2a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6e1a11-3cfe-45f3-a0c2-47568e6c0020", "name": "network-vif-deleted", "tag": "82b98b21-382e-49c9-82b3-d824f014d3ed"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:08.035112 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:08.042078 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-42e22cf6-4750-47d7-8656-b80f2a5843b8 req-1ae68a43-ab99-4164-8fbe-76199e2c2a57 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:08.044595 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-42e22cf6-4750-47d7-8656-b80f2a5843b8 req-1ae68a43-ab99-4164-8fbe-76199e2c2a57 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:08.045320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-42e22cf6-4750-47d7-8656-b80f2a5843b8 req-1ae68a43-ab99-4164-8fbe-76199e2c2a57 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:08.058256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-42e22cf6-4750-47d7-8656-b80f2a5843b8 req-1ae68a43-ab99-4164-8fbe-76199e2c2a57 service nova] Creating event network-vif-deleted:82b98b21-382e-49c9-82b3-d824f014d3ed for instance 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 on hv-cinder-74915 Oct 14 18:00:08.063685 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-42e22cf6-4750-47d7-8656-b80f2a5843b8 req-1ae68a43-ab99-4164-8fbe-76199e2c2a57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040797 Oct 14 18:00:08.064309 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 305/617] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:08.646607 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:08.647404 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:08.654216 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:08.654696 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:08.655128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:08.655820 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:08.656307 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:08.656726 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:08.691029 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:08.691513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:08.691979 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:08.692427 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lazy-loading 'fault' on Instance uuid 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:00:08.747708 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:08.758934 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ce8114a7-ca78-4b12-9cdb-ddb3afae0cbe tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 200 len: 1312 microversion: 2.1 time: 0.116106 Oct 14 18:00:08.759558 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 313/618] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:08 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:09.784512 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:09.785343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:09.793471 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:09.794633 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:09.795047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:09.795898 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:09.796264 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:09.796914 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:09.811194 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] HTTP exception thrown: Instance 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 could not be found. Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Request method failure captured: Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 HTTP/1.1 Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaKDmRrof5YHVAQuXH5mCmDyChagswaliw2J6djtI1m1MzfFbX_OeNHyKd6c1qH-kQE6f6YepZsCS80ByX10HmAJEJ4z6UGwvEVyJkW_2zz4EnwAkiavkywX7UaHyl4vi6r80kNDj3tqM4-o-KGZziEuY7SpETnctapai-BZfnW-4co Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 530fdfc3448a40b7aa85170873d3f0ff Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:00:09.812977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_530fdfc3448a40b7aa85170873d3f0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 530fdfc3448a40b7aa85170873d3f0ff Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-ServerRescueNegativeTestJSON-155189197-project Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: c091bf027839447da4c713deb291ed1f Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-ServerRescueNegativeTestJSON-155189197-project Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 could not be found. Oct 14 18:00:09.814424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': '3d6e1a11-3cfe-45f3-a0c2-47568e6c0020'} Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 could not be found. Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:00:09.815212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 could not be found. Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 could not be found. Oct 14 18:00:09.816405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:09.817437 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Returning 404 to user: Instance 3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:00:09.817437 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8555f69b-0a1b-46b5-af98-5474e3f80fd2 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020" status: 404 len: 111 microversion: 2.1 time: 0.034131 Oct 14 18:00:09.817437 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 306/619] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:09 2022] GET /compute/v2.1/servers/3d6e1a11-3cfe-45f3-a0c2-47568e6c0020 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:00:09.822851 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4d5e12cf-085c-46d4-9271-4e416d553a12 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:09.823335 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4d5e12cf-085c-46d4-9271-4e416d553a12 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:09.830727 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d5e12cf-085c-46d4-9271-4e416d553a12 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:09.831198 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d5e12cf-085c-46d4-9271-4e416d553a12 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:09.831626 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d5e12cf-085c-46d4-9271-4e416d553a12 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:09.832375 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d5e12cf-085c-46d4-9271-4e416d553a12 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:09.832818 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d5e12cf-085c-46d4-9271-4e416d553a12 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:09.833230 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4d5e12cf-085c-46d4-9271-4e416d553a12 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:09.858907 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4d5e12cf-085c-46d4-9271-4e416d553a12 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:00:09.938046 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4d5e12cf-085c-46d4-9271-4e416d553a12 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 204 len: 0 microversion: 2.1 time: 0.118613 Oct 14 18:00:09.938728 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 314/620] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:00:09 2022] DELETE /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:00:09.948367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1da3c971-1687-4da8-b02c-64e79b3047c7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:09.948978 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1da3c971-1687-4da8-b02c-64e79b3047c7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:09.951720 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=4 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:09.957645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1da3c971-1687-4da8-b02c-64e79b3047c7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:09.958135 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1da3c971-1687-4da8-b02c-64e79b3047c7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:09.958570 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1da3c971-1687-4da8-b02c-64e79b3047c7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:09.959267 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1da3c971-1687-4da8-b02c-64e79b3047c7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:09.959719 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1da3c971-1687-4da8-b02c-64e79b3047c7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:09.960173 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1da3c971-1687-4da8-b02c-64e79b3047c7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:09.979149 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:10.102425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1da3c971-1687-4da8-b02c-64e79b3047c7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:10.110210 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1da3c971-1687-4da8-b02c-64e79b3047c7 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.166515 Oct 14 18:00:10.110775 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 307/621] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:09 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:11.135240 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ee3c4b18-312e-41cd-9b21-61a4984da586 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:11.135849 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ee3c4b18-312e-41cd-9b21-61a4984da586 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:11.142368 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ee3c4b18-312e-41cd-9b21-61a4984da586 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:11.142845 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ee3c4b18-312e-41cd-9b21-61a4984da586 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:11.143270 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ee3c4b18-312e-41cd-9b21-61a4984da586 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:11.143978 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ee3c4b18-312e-41cd-9b21-61a4984da586 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:11.144460 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ee3c4b18-312e-41cd-9b21-61a4984da586 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:11.144876 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ee3c4b18-312e-41cd-9b21-61a4984da586 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:11.279718 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ee3c4b18-312e-41cd-9b21-61a4984da586 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:11.288826 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ee3c4b18-312e-41cd-9b21-61a4984da586 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.158301 Oct 14 18:00:11.289409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 315/622] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:11 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:11.738535 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-70d8aad4-5b3d-437b-acae-c6f0ded583c3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-782805704"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:11.739163 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-70d8aad4-5b3d-437b-acae-c6f0ded583c3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:11.745394 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-70d8aad4-5b3d-437b-acae-c6f0ded583c3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:11.745879 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-70d8aad4-5b3d-437b-acae-c6f0ded583c3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:11.746308 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-70d8aad4-5b3d-437b-acae-c6f0ded583c3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:11.746988 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-70d8aad4-5b3d-437b-acae-c6f0ded583c3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:11.747436 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-70d8aad4-5b3d-437b-acae-c6f0ded583c3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:11.747855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-70d8aad4-5b3d-437b-acae-c6f0ded583c3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:11.875408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.network.security_group_api [None req-70d8aad4-5b3d-437b-acae-c6f0ded583c3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Removing security group ec1e3e5c-00a6-4a33-9fab-4f16b207bdb5 from port 687bc207-2144-4d90-83f9-83cd2654a936 Oct 14 18:00:12.190488 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-70d8aad4-5b3d-437b-acae-c6f0ded583c3 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "POST /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/action" status: 202 len: 0 microversion: 2.1 time: 0.455763 Oct 14 18:00:12.191540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 308/623] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 18:00:11 2022] POST /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:00:12.202503 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-8126b087-cec1-4240-bbab-aeb200506691 req-d7f67c64-f2b7-46ee-a76f-f8e17ae65733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9a8094-ee6e-4a32-96a6-94c18538fd29", "tag": "687bc207-2144-4d90-83f9-83cd2654a936"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:12.230784 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-8126b087-cec1-4240-bbab-aeb200506691 req-d7f67c64-f2b7-46ee-a76f-f8e17ae65733 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:12.231961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-8126b087-cec1-4240-bbab-aeb200506691 req-d7f67c64-f2b7-46ee-a76f-f8e17ae65733 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:12.235207 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-8126b087-cec1-4240-bbab-aeb200506691 req-d7f67c64-f2b7-46ee-a76f-f8e17ae65733 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:12.247299 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-8126b087-cec1-4240-bbab-aeb200506691 req-d7f67c64-f2b7-46ee-a76f-f8e17ae65733 service nova] Creating event network-changed:687bc207-2144-4d90-83f9-83cd2654a936 for instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 on hv-cinder-74915 Oct 14 18:00:12.253628 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-8126b087-cec1-4240-bbab-aeb200506691 req-d7f67c64-f2b7-46ee-a76f-f8e17ae65733 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056641 Oct 14 18:00:12.255178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 316/624] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:12.313278 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4a48f341-38d0-42c1-830e-e7b69dde037a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:12.314155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4a48f341-38d0-42c1-830e-e7b69dde037a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:12.321425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4a48f341-38d0-42c1-830e-e7b69dde037a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:12.322177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4a48f341-38d0-42c1-830e-e7b69dde037a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:12.322811 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4a48f341-38d0-42c1-830e-e7b69dde037a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:12.323676 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4a48f341-38d0-42c1-830e-e7b69dde037a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:12.324318 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4a48f341-38d0-42c1-830e-e7b69dde037a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:12.324747 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4a48f341-38d0-42c1-830e-e7b69dde037a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:12.575227 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-4a48f341-38d0-42c1-830e-e7b69dde037a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:12.591051 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4a48f341-38d0-42c1-830e-e7b69dde037a tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.282364 Oct 14 18:00:12.594330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 309/625] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:12 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:00:13.335091 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9f14b5cd-b0f2-4df1-8b8e-9bbf2fb2a790 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:13.335666 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9f14b5cd-b0f2-4df1-8b8e-9bbf2fb2a790 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:13.352592 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f14b5cd-b0f2-4df1-8b8e-9bbf2fb2a790 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:13.353083 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f14b5cd-b0f2-4df1-8b8e-9bbf2fb2a790 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:13.353514 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f14b5cd-b0f2-4df1-8b8e-9bbf2fb2a790 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:13.354217 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f14b5cd-b0f2-4df1-8b8e-9bbf2fb2a790 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:13.354675 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f14b5cd-b0f2-4df1-8b8e-9bbf2fb2a790 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:13.355094 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9f14b5cd-b0f2-4df1-8b8e-9bbf2fb2a790 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:13.454501 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-9f14b5cd-b0f2-4df1-8b8e-9bbf2fb2a790 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lazy-loading 'services' on Instance uuid ea9a8094-ee6e-4a32-96a6-94c18538fd29 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:00:13.539247 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9f14b5cd-b0f2-4df1-8b8e-9bbf2fb2a790 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments/730a1f79-00d5-4a10-8922-f7d94b75c72a" status: 202 len: 0 microversion: 2.1 time: 0.208648 Oct 14 18:00:13.543405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 317/626] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 18:00:13 2022] DELETE /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments/730a1f79-00d5-4a10-8922-f7d94b75c72a => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:00:13.552735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b026b0f8-42e9-4e5d-9ef5-34ba8da68e49 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:13.561170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b026b0f8-42e9-4e5d-9ef5-34ba8da68e49 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:13.569796 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b026b0f8-42e9-4e5d-9ef5-34ba8da68e49 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:13.570933 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b026b0f8-42e9-4e5d-9ef5-34ba8da68e49 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:13.572449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b026b0f8-42e9-4e5d-9ef5-34ba8da68e49 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:13.573907 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b026b0f8-42e9-4e5d-9ef5-34ba8da68e49 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:13.575231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b026b0f8-42e9-4e5d-9ef5-34ba8da68e49 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:13.575915 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-b026b0f8-42e9-4e5d-9ef5-34ba8da68e49 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:13.615013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b026b0f8-42e9-4e5d-9ef5-34ba8da68e49 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070097 Oct 14 18:00:13.616176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 310/627] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:00:13 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:00:13.622366 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b6e4469b-572d-45bb-a219-4780a46503a8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:13.623118 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b6e4469b-572d-45bb-a219-4780a46503a8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:13.636144 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6e4469b-572d-45bb-a219-4780a46503a8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:13.636636 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6e4469b-572d-45bb-a219-4780a46503a8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:13.637077 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6e4469b-572d-45bb-a219-4780a46503a8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:13.637776 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6e4469b-572d-45bb-a219-4780a46503a8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:13.638220 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6e4469b-572d-45bb-a219-4780a46503a8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:13.638981 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b6e4469b-572d-45bb-a219-4780a46503a8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:13.850958 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b6e4469b-572d-45bb-a219-4780a46503a8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:13.858786 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b6e4469b-572d-45bb-a219-4780a46503a8 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1521 microversion: 2.1 time: 0.244907 Oct 14 18:00:13.859353 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 318/628] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:13 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:14.269612 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-6623d437-b4a9-4758-8bdb-4a4bb9b0cd39 req-cae411d1-6cf1-4ed6-94ce-4f1e5549d3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9a8094-ee6e-4a32-96a6-94c18538fd29", "tag": "687bc207-2144-4d90-83f9-83cd2654a936"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:14.279118 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-6623d437-b4a9-4758-8bdb-4a4bb9b0cd39 req-cae411d1-6cf1-4ed6-94ce-4f1e5549d3a0 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:14.279620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-6623d437-b4a9-4758-8bdb-4a4bb9b0cd39 req-cae411d1-6cf1-4ed6-94ce-4f1e5549d3a0 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:14.280307 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-6623d437-b4a9-4758-8bdb-4a4bb9b0cd39 req-cae411d1-6cf1-4ed6-94ce-4f1e5549d3a0 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:14.292403 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-6623d437-b4a9-4758-8bdb-4a4bb9b0cd39 req-cae411d1-6cf1-4ed6-94ce-4f1e5549d3a0 service nova] Creating event network-changed:687bc207-2144-4d90-83f9-83cd2654a936 for instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 on hv-cinder-74915 Oct 14 18:00:14.298046 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-6623d437-b4a9-4758-8bdb-4a4bb9b0cd39 req-cae411d1-6cf1-4ed6-94ce-4f1e5549d3a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032020 Oct 14 18:00:14.299147 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 311/629] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:14.630007 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-95c17b0d-2e4d-441e-814c-7f2b3547d304 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:14.633044 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-95c17b0d-2e4d-441e-814c-7f2b3547d304 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:14.642059 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-95c17b0d-2e4d-441e-814c-7f2b3547d304 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:14.643061 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-95c17b0d-2e4d-441e-814c-7f2b3547d304 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:14.644487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-95c17b0d-2e4d-441e-814c-7f2b3547d304 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:14.646132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-95c17b0d-2e4d-441e-814c-7f2b3547d304 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:14.646752 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-95c17b0d-2e4d-441e-814c-7f2b3547d304 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:14.647333 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-95c17b0d-2e4d-441e-814c-7f2b3547d304 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:14.686645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-95c17b0d-2e4d-441e-814c-7f2b3547d304 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060197 Oct 14 18:00:14.687671 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 319/630] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:00:14 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:14.799083 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-3c9b34b5-4b58-4568-ada3-e499f1cfe9d4 req-6aa29941-7f05-4f3c-914e-45cbe6173d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f20c98-c68a-4dbb-8f8b-0506c63f5d6a", "name": "network-vif-deleted", "tag": "5c0c93a0-251d-455a-ae8a-79932ce54280"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:14.812469 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-3c9b34b5-4b58-4568-ada3-e499f1cfe9d4 req-6aa29941-7f05-4f3c-914e-45cbe6173d81 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:14.812883 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-3c9b34b5-4b58-4568-ada3-e499f1cfe9d4 req-6aa29941-7f05-4f3c-914e-45cbe6173d81 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:14.813304 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-3c9b34b5-4b58-4568-ada3-e499f1cfe9d4 req-6aa29941-7f05-4f3c-914e-45cbe6173d81 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:14.824807 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-3c9b34b5-4b58-4568-ada3-e499f1cfe9d4 req-6aa29941-7f05-4f3c-914e-45cbe6173d81 service nova] Creating event network-vif-deleted:5c0c93a0-251d-455a-ae8a-79932ce54280 for instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a on hv-cinder-74915 Oct 14 18:00:14.830343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-3c9b34b5-4b58-4568-ada3-e499f1cfe9d4 req-6aa29941-7f05-4f3c-914e-45cbe6173d81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036157 Oct 14 18:00:14.830945 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 312/631] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:14.882042 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:14.882662 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:14.888757 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:14.889247 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:14.889772 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:14.890688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:14.891151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:14.891573 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:14.896049 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:14.926779 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:14.927509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:14.928133 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:14.928778 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lazy-loading 'fault' on Instance uuid 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:00:14.987766 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c091bf027839447da4c713deb291ed1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530fdfc3448a40b7aa85170873d3f0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:14.996245 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-296a517a-deb2-433e-b7a4-54fb47717ed3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 200 len: 1312 microversion: 2.1 time: 0.118286 Oct 14 18:00:14.996815 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 320/632] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:14 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:00:15.699340 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0f55ac5f-e50e-4c22-8de1-317a10b98ee1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:15.701694 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0f55ac5f-e50e-4c22-8de1-317a10b98ee1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:15.707924 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0f55ac5f-e50e-4c22-8de1-317a10b98ee1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:15.708414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0f55ac5f-e50e-4c22-8de1-317a10b98ee1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:15.708855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0f55ac5f-e50e-4c22-8de1-317a10b98ee1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:15.709550 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0f55ac5f-e50e-4c22-8de1-317a10b98ee1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:15.710008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0f55ac5f-e50e-4c22-8de1-317a10b98ee1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:15.710436 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0f55ac5f-e50e-4c22-8de1-317a10b98ee1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:15.739783 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0f55ac5f-e50e-4c22-8de1-317a10b98ee1 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044844 Oct 14 18:00:15.740367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 313/633] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:00:15 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 18:00:15.752406 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:15.752893 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:15.759062 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:15.759534 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:15.759997 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:15.760673 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:15.761114 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:15.761527 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:15.836345 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] HTTP exception thrown: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 is not attached to volume 730a1f79-00d5-4a10-8922-f7d94b75c72a Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Request method failure captured: Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: DELETE /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments/730a1f79-00d5-4a10-8922-f7d94b75c72a HTTP/1.1 Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaL3JPfJQXmLoVo8B9k92lkM7dOoPnA-KU6pgdFLjokI9LqWtiRRb5mMBlrUdIW3vcJLpSPJKoRpkw0OJPmHMfZJnBul-bQQcl7xyVe_Y36dsDv_fBcN5XL7ED7CU8ZarMYg3WFj0iy7Tw-_GX-p-IrObn9XsxNa6mAvGypZl2UGu-s Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: f41c0e3b1239415ba4105ca5014cbe28 Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-TestMinimumBasicScenario-1677793199 Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:00:15.839021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f41c0e3b1239415ba4105ca5014cbe28", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f41c0e3b1239415ba4105ca5014cbe28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f41c0e3b1239415ba4105ca5014cbe28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f41c0e3b1239415ba4105ca5014cbe28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-TestMinimumBasicScenario-1677793199 Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: f41c0e3b1239415ba4105ca5014cbe28 Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1677793199 Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-TestMinimumBasicScenario-1677793199-project Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 01e84d6714b34da89292b2246b04d404 Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-TestMinimumBasicScenario-1677793199-project Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:00:15.840635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 is not attached to volume 730a1f79-00d5-4a10-8922-f7d94b75c72a Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'server_id': 'ea9a8094-ee6e-4a32-96a6-94c18538fd29', 'id': '730a1f79-00d5-4a10-8922-f7d94b75c72a'} Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 730a1f79-00d5-4a10-8922-f7d94b75c72a. Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:00:15.841564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 is not attached to volume 730a1f79-00d5-4a10-8922-f7d94b75c72a Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 is not attached to volume 730a1f79-00d5-4a10-8922-f7d94b75c72a Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:00:15.844030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Returning 404 to user: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 is not attached to volume 730a1f79-00d5-4a10-8922-f7d94b75c72a {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:00:15.845292 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4ed542fc-5d12-4ae8-a1ff-a8916319091c tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments/730a1f79-00d5-4a10-8922-f7d94b75c72a" status: 404 len: 154 microversion: 2.1 time: 0.093624 Oct 14 18:00:15.845292 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 321/634] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 18:00:15 2022] DELETE /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29/os-volume_attachments/730a1f79-00d5-4a10-8922-f7d94b75c72a => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:00:16.123001 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:16.123872 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] [instance: 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:16.129968 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:16.130477 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:16.130960 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:16.131773 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:16.132256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:16.132728 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:16.147046 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] HTTP exception thrown: Instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a could not be found. Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Request method failure captured: Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a HTTP/1.1 Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaKDmRrof5YHVAQuXH5mCmDyChagswaliw2J6djtI1m1MzfFbX_OeNHyKd6c1qH-kQE6f6YepZsCS80ByX10HmAJEJ4z6UGwvEVyJkW_2zz4EnwAkiavkywX7UaHyl4vi6r80kNDj3tqM4-o-KGZziEuY7SpETnctapai-BZfnW-4co Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 530fdfc3448a40b7aa85170873d3f0ff Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:00:16.150690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_530fdfc3448a40b7aa85170873d3f0ff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/530fdfc3448a40b7aa85170873d3f0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 530fdfc3448a40b7aa85170873d3f0ff Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-155189197 Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-ServerRescueNegativeTestJSON-155189197-project Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: c091bf027839447da4c713deb291ed1f Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-ServerRescueNegativeTestJSON-155189197-project Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a could not be found. Oct 14 18:00:16.152062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': '36f20c98-c68a-4dbb-8f8b-0506c63f5d6a'} Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a could not be found. Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:00:16.152831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a could not be found. Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a could not be found. Oct 14 18:00:16.154021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:00:16.156451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] Returning 404 to user: Instance 36f20c98-c68a-4dbb-8f8b-0506c63f5d6a could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:00:16.156451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-bf32cd03-034b-48e3-8efd-43f6b45847e3 tempest-ServerRescueNegativeTestJSON-155189197 tempest-ServerRescueNegativeTestJSON-155189197-project] 10.222.0.27 "GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a" status: 404 len: 111 microversion: 2.1 time: 0.134792 Oct 14 18:00:16.156451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 314/635] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:16 2022] GET /compute/v2.1/servers/36f20c98-c68a-4dbb-8f8b-0506c63f5d6a => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:00:16.981873 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-81055a12-fd86-44aa-b9de-5542025430d5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:16.982374 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-81055a12-fd86-44aa-b9de-5542025430d5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:16.989509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81055a12-fd86-44aa-b9de-5542025430d5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:16.989989 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81055a12-fd86-44aa-b9de-5542025430d5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:16.990422 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81055a12-fd86-44aa-b9de-5542025430d5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:16.991111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81055a12-fd86-44aa-b9de-5542025430d5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:16.991566 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81055a12-fd86-44aa-b9de-5542025430d5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:16.992014 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81055a12-fd86-44aa-b9de-5542025430d5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:17.017258 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-81055a12-fd86-44aa-b9de-5542025430d5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:00:17.095600 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-81055a12-fd86-44aa-b9de-5542025430d5 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 204 len: 0 microversion: 2.1 time: 0.117363 Oct 14 18:00:17.096555 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 322/636] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:00:16 2022] DELETE /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:00:17.105583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8d882fc4-faf2-4b32-b190-d06f849b97d8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:17.108598 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8d882fc4-faf2-4b32-b190-d06f849b97d8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:17.119390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8d882fc4-faf2-4b32-b190-d06f849b97d8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:17.121265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8d882fc4-faf2-4b32-b190-d06f849b97d8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:17.121707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8d882fc4-faf2-4b32-b190-d06f849b97d8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:17.122421 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8d882fc4-faf2-4b32-b190-d06f849b97d8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:17.122878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8d882fc4-faf2-4b32-b190-d06f849b97d8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:17.123514 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8d882fc4-faf2-4b32-b190-d06f849b97d8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:17.351621 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8d882fc4-faf2-4b32-b190-d06f849b97d8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:17.362304 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8d882fc4-faf2-4b32-b190-d06f849b97d8 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1553 microversion: 2.1 time: 0.260834 Oct 14 18:00:17.362881 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 315/637] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:17 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:18.387740 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f27ee3bc-3042-4120-9a74-86c80854d35e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:18.388543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f27ee3bc-3042-4120-9a74-86c80854d35e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:18.403191 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f27ee3bc-3042-4120-9a74-86c80854d35e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:18.403692 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f27ee3bc-3042-4120-9a74-86c80854d35e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:18.404161 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f27ee3bc-3042-4120-9a74-86c80854d35e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:18.405566 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f27ee3bc-3042-4120-9a74-86c80854d35e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:18.405705 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f27ee3bc-3042-4120-9a74-86c80854d35e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:18.406143 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f27ee3bc-3042-4120-9a74-86c80854d35e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:18.604458 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-734631305", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-941379814", "security_groups": [{"name": "tempest-secgroup-smoke-804492061"}], "block_device_mapping_v2": [{"uuid": "8f5b2109-e3ca-4d32-98f6-6e9a03711617", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "976baf89-2f42-4a40-b24d-859f3e36aec4"}]}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:18.733254 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f27ee3bc-3042-4120-9a74-86c80854d35e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:18.740838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f27ee3bc-3042-4120-9a74-86c80854d35e tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1553 microversion: 2.1 time: 0.358223 Oct 14 18:00:18.741720 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 323/638] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:18 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1553 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:18.791240 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.network.neutron [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] validate_networks() for [('976baf89-2f42-4a40-b24d-859f3e36aec4', None, None, None, None, None)] {{(pid=118656) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 18:00:19.601997 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Flavor limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 18:00:19.602412 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Image limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 18:00:19.602886 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Flavor pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 18:00:19.603297 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Image pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 18:00:19.603724 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 18:00:19.618211 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:19.619537 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:19.620442 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:19.622001 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:19.622666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:19.623852 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:19.652350 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Getting quotas for project 87b79c338b0047dfb68e9a5b9b16c51b. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:00:19.660510 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Getting quotas for user 072cedf1a6a24f6fa7d7ed92981344dd and project 87b79c338b0047dfb68e9a5b9b16c51b. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:00:19.734574 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Going to run 1 instances... {{(pid=118656) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 18:00:19.737926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f5b2109-e3ca-4d32-98f6-6e9a03711617',volume_size=None,volume_type=None)] {{(pid=118656) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 18:00:19.765770 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f0e94961-7727-4ae0-860f-a57aa5ccaa7f tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:19.766557 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f0e94961-7727-4ae0-860f-a57aa5ccaa7f tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:19.780193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0e94961-7727-4ae0-860f-a57aa5ccaa7f tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:19.780788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0e94961-7727-4ae0-860f-a57aa5ccaa7f tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:19.781237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0e94961-7727-4ae0-860f-a57aa5ccaa7f tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:19.781972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0e94961-7727-4ae0-860f-a57aa5ccaa7f tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:19.782424 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0e94961-7727-4ae0-860f-a57aa5ccaa7f tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:19.782841 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0e94961-7727-4ae0-860f-a57aa5ccaa7f tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:19.985062 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f0e94961-7727-4ae0-860f-a57aa5ccaa7f tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e84d6714b34da89292b2246b04d404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41c0e3b1239415ba4105ca5014cbe28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:19.995009 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f0e94961-7727-4ae0-860f-a57aa5ccaa7f tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 200 len: 1511 microversion: 2.1 time: 0.233764 Oct 14 18:00:19.998341 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 324/639] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:19 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:20.004254 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-2932fcc3-c515-4750-bda8-4ddc901e90cd req-40be161b-4cbb-4de8-a4c9-e60e09bf1756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9a8094-ee6e-4a32-96a6-94c18538fd29", "name": "network-vif-deleted", "tag": "687bc207-2144-4d90-83f9-83cd2654a936"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:20.025174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2932fcc3-c515-4750-bda8-4ddc901e90cd req-40be161b-4cbb-4de8-a4c9-e60e09bf1756 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:20.026081 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2932fcc3-c515-4750-bda8-4ddc901e90cd req-40be161b-4cbb-4de8-a4c9-e60e09bf1756 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:20.026745 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2932fcc3-c515-4750-bda8-4ddc901e90cd req-40be161b-4cbb-4de8-a4c9-e60e09bf1756 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:20.039583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-79209251-b7c1-462e-83f9-ed2407e44d6f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.439087 Oct 14 18:00:20.040846 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 316/640] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 18:00:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 18:00:20.057417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c3ab4c6c-e7d7-461d-95e9-502ea5fff312 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:20.058802 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c3ab4c6c-e7d7-461d-95e9-502ea5fff312 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:20.063861 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-2932fcc3-c515-4750-bda8-4ddc901e90cd req-40be161b-4cbb-4de8-a4c9-e60e09bf1756 service nova] Creating event network-vif-deleted:687bc207-2144-4d90-83f9-83cd2654a936 for instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 on hv-cinder-74915 Oct 14 18:00:20.076923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-2932fcc3-c515-4750-bda8-4ddc901e90cd req-40be161b-4cbb-4de8-a4c9-e60e09bf1756 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075964 Oct 14 18:00:20.078290 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 325/641] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:20.147906 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c3ab4c6c-e7d7-461d-95e9-502ea5fff312 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:20.159711 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c3ab4c6c-e7d7-461d-95e9-502ea5fff312 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1093 microversion: 2.1 time: 0.110174 Oct 14 18:00:20.160617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 317/642] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:20 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1093 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:00:21.024868 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:21.025718 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] [instance: ea9a8094-ee6e-4a32-96a6-94c18538fd29] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:21.032316 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:21.032789 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:21.033215 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:21.033895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:21.034337 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:21.034751 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:21.050703 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] HTTP exception thrown: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 could not be found. Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Request method failure captured: Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 HTTP/1.1 Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaL3JPfJQXmLoVo8B9k92lkM7dOoPnA-KU6pgdFLjokI9LqWtiRRb5mMBlrUdIW3vcJLpSPJKoRpkw0OJPmHMfZJnBul-bQQcl7xyVe_Y36dsDv_fBcN5XL7ED7CU8ZarMYg3WFj0iy7Tw-_GX-p-IrObn9XsxNa6mAvGypZl2UGu-s Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: f41c0e3b1239415ba4105ca5014cbe28 Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-TestMinimumBasicScenario-1677793199 Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:00:21.055028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f41c0e3b1239415ba4105ca5014cbe28", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f41c0e3b1239415ba4105ca5014cbe28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f41c0e3b1239415ba4105ca5014cbe28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f41c0e3b1239415ba4105ca5014cbe28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-TestMinimumBasicScenario-1677793199 Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: f41c0e3b1239415ba4105ca5014cbe28 Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1677793199 Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-TestMinimumBasicScenario-1677793199-project Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 01e84d6714b34da89292b2246b04d404 Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-TestMinimumBasicScenario-1677793199-project Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 could not be found. Oct 14 18:00:21.056536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'ea9a8094-ee6e-4a32-96a6-94c18538fd29'} Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 could not be found. Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:00:21.057744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 could not be found. Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 could not be found. Oct 14 18:00:21.058992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:00:21.060170 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Returning 404 to user: Instance ea9a8094-ee6e-4a32-96a6-94c18538fd29 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:00:21.060170 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8887b318-e0ed-47a6-a17e-57c44141f048 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29" status: 404 len: 111 microversion: 2.1 time: 0.033571 Oct 14 18:00:21.062707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-25f1810e-b2c8-481a-8c89-9322ed690d26 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] Calling method '.version_select at 0x7fe3da4db160>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:21.063972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 326/643] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:21 2022] GET /compute/v2.1/servers/ea9a8094-ee6e-4a32-96a6-94c18538fd29 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:00:21.083208 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-25f1810e-b2c8-481a-8c89-9322ed690d26 tempest-TestMinimumBasicScenario-1677793199 tempest-TestMinimumBasicScenario-1677793199-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1958202178" status: 202 len: 0 microversion: 2.1 time: 0.024680 Oct 14 18:00:21.087209 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 318/644] 10.222.0.27 () {58 vars in 1272 bytes} [Fri Oct 14 18:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1958202178 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:00:21.184680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6030a075-0395-46ab-90fa-0ee43b3c2a19 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:21.185390 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6030a075-0395-46ab-90fa-0ee43b3c2a19 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:21.191938 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6030a075-0395-46ab-90fa-0ee43b3c2a19 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:21.192615 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6030a075-0395-46ab-90fa-0ee43b3c2a19 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:21.193239 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6030a075-0395-46ab-90fa-0ee43b3c2a19 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:21.193937 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6030a075-0395-46ab-90fa-0ee43b3c2a19 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:21.194563 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6030a075-0395-46ab-90fa-0ee43b3c2a19 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:21.195143 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6030a075-0395-46ab-90fa-0ee43b3c2a19 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:21.260037 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6030a075-0395-46ab-90fa-0ee43b3c2a19 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:21.270092 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6030a075-0395-46ab-90fa-0ee43b3c2a19 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1191 microversion: 2.1 time: 0.089104 Oct 14 18:00:21.270670 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 327/645] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:21 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:22.296436 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4c496cb3-4a88-41b1-863a-02ce2620b14d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:22.297945 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4c496cb3-4a88-41b1-863a-02ce2620b14d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:22.306628 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c496cb3-4a88-41b1-863a-02ce2620b14d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:22.307314 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c496cb3-4a88-41b1-863a-02ce2620b14d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:22.308022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c496cb3-4a88-41b1-863a-02ce2620b14d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:22.308928 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c496cb3-4a88-41b1-863a-02ce2620b14d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:22.309597 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c496cb3-4a88-41b1-863a-02ce2620b14d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:22.310130 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4c496cb3-4a88-41b1-863a-02ce2620b14d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:22.560716 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-4c496cb3-4a88-41b1-863a-02ce2620b14d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:22.572296 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4c496cb3-4a88-41b1-863a-02ce2620b14d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1276 microversion: 2.1 time: 0.281505 Oct 14 18:00:22.573359 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 319/646] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:22 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1276 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:23.595098 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b8328d7a-3570-47e6-b4c6-0f47256d54de tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:23.595709 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b8328d7a-3570-47e6-b4c6-0f47256d54de tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:23.602539 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8328d7a-3570-47e6-b4c6-0f47256d54de tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:23.603271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8328d7a-3570-47e6-b4c6-0f47256d54de tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:23.603905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8328d7a-3570-47e6-b4c6-0f47256d54de tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:23.604801 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8328d7a-3570-47e6-b4c6-0f47256d54de tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:23.605537 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8328d7a-3570-47e6-b4c6-0f47256d54de tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:23.606119 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8328d7a-3570-47e6-b4c6-0f47256d54de tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:23.996813 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b8328d7a-3570-47e6-b4c6-0f47256d54de tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:24.007110 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b8328d7a-3570-47e6-b4c6-0f47256d54de tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1264 microversion: 2.1 time: 0.416348 Oct 14 18:00:24.007920 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 328/647] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:23 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1264 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:24.318335 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-53899b61-4b08-4acd-96b7-121172946ddd req-00cf80ef-7f0d-4e8b-bdfe-bc37f3dc0684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2a9478-c81a-49f6-9176-c90b6e15466f", "tag": "7e54b253-263a-42cf-8f31-9f4a5d1746bc"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:24.341496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-53899b61-4b08-4acd-96b7-121172946ddd req-00cf80ef-7f0d-4e8b-bdfe-bc37f3dc0684 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:24.342713 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-53899b61-4b08-4acd-96b7-121172946ddd req-00cf80ef-7f0d-4e8b-bdfe-bc37f3dc0684 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:24.343317 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-53899b61-4b08-4acd-96b7-121172946ddd req-00cf80ef-7f0d-4e8b-bdfe-bc37f3dc0684 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:24.381354 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-53899b61-4b08-4acd-96b7-121172946ddd req-00cf80ef-7f0d-4e8b-bdfe-bc37f3dc0684 service nova] Creating event network-changed:7e54b253-263a-42cf-8f31-9f4a5d1746bc for instance fd2a9478-c81a-49f6-9176-c90b6e15466f on hv-cinder-74915 Oct 14 18:00:24.398866 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-53899b61-4b08-4acd-96b7-121172946ddd req-00cf80ef-7f0d-4e8b-bdfe-bc37f3dc0684 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083925 Oct 14 18:00:24.401369 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 320/648] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:25.037271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7c549051-8b30-4a6e-b0d8-d64e871b8ac1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:25.038716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7c549051-8b30-4a6e-b0d8-d64e871b8ac1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:25.050607 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7c549051-8b30-4a6e-b0d8-d64e871b8ac1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:25.052474 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7c549051-8b30-4a6e-b0d8-d64e871b8ac1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:25.053129 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7c549051-8b30-4a6e-b0d8-d64e871b8ac1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:25.054645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7c549051-8b30-4a6e-b0d8-d64e871b8ac1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:25.055446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7c549051-8b30-4a6e-b0d8-d64e871b8ac1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:25.056342 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7c549051-8b30-4a6e-b0d8-d64e871b8ac1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:25.370064 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7c549051-8b30-4a6e-b0d8-d64e871b8ac1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:25.387895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7c549051-8b30-4a6e-b0d8-d64e871b8ac1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1264 microversion: 2.1 time: 0.359470 Oct 14 18:00:25.401392 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 329/649] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:25 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1264 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:26.419065 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2d1a4801-2842-48bc-b257-583c3a606785 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:26.420055 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2d1a4801-2842-48bc-b257-583c3a606785 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:26.439405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2d1a4801-2842-48bc-b257-583c3a606785 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:26.441883 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2d1a4801-2842-48bc-b257-583c3a606785 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:26.442354 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2d1a4801-2842-48bc-b257-583c3a606785 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:26.443083 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2d1a4801-2842-48bc-b257-583c3a606785 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:26.443730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2d1a4801-2842-48bc-b257-583c3a606785 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:26.444186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2d1a4801-2842-48bc-b257-583c3a606785 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:26.654411 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2d1a4801-2842-48bc-b257-583c3a606785 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:26.663855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2d1a4801-2842-48bc-b257-583c3a606785 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1264 microversion: 2.1 time: 0.254695 Oct 14 18:00:26.668359 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 321/650] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:26 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:27.691480 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2a2d846c-80f9-4e7d-a2a5-b5d08f0c38e6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:27.692913 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2a2d846c-80f9-4e7d-a2a5-b5d08f0c38e6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:27.699982 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a2d846c-80f9-4e7d-a2a5-b5d08f0c38e6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:27.700810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a2d846c-80f9-4e7d-a2a5-b5d08f0c38e6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:27.702434 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a2d846c-80f9-4e7d-a2a5-b5d08f0c38e6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:27.703496 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a2d846c-80f9-4e7d-a2a5-b5d08f0c38e6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:27.704097 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a2d846c-80f9-4e7d-a2a5-b5d08f0c38e6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:27.704624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2a2d846c-80f9-4e7d-a2a5-b5d08f0c38e6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:27.854867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2a2d846c-80f9-4e7d-a2a5-b5d08f0c38e6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:27.864824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2a2d846c-80f9-4e7d-a2a5-b5d08f0c38e6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1264 microversion: 2.1 time: 0.177815 Oct 14 18:00:27.866128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 330/651] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:27 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:28.893588 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4732f7fe-3085-4677-85a6-4e6497e0f2b5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:28.894910 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4732f7fe-3085-4677-85a6-4e6497e0f2b5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:28.907474 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4732f7fe-3085-4677-85a6-4e6497e0f2b5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:28.907979 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4732f7fe-3085-4677-85a6-4e6497e0f2b5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:28.908414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4732f7fe-3085-4677-85a6-4e6497e0f2b5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:28.909314 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4732f7fe-3085-4677-85a6-4e6497e0f2b5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:28.909940 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4732f7fe-3085-4677-85a6-4e6497e0f2b5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:28.910520 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4732f7fe-3085-4677-85a6-4e6497e0f2b5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:29.056596 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-4732f7fe-3085-4677-85a6-4e6497e0f2b5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:29.068193 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4732f7fe-3085-4677-85a6-4e6497e0f2b5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1264 microversion: 2.1 time: 0.182962 Oct 14 18:00:29.068790 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 322/652] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:28 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:29.573741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3e3ef4f8-66ba-4cb8-b28e-67582a2f40e7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: .version_select at 0x7fe3da6b74c0>, body: {"keypair": {"name": "tempest-keypair-801541812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyNcEMUgrucql8WigLHpEoQ3EkQwcaMtQ7gIS9kUW6lNbGsvMWfoB80O0Ki1dEvuioL2P3NELSCFvyrGyucSoY1yU0FWRiFGZzEAYmNoDB1IPrxQoN6sSfNj+oI0wDCzQ=="}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:29.595668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-3e3ef4f8-66ba-4cb8-b28e-67582a2f40e7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'key_pairs'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:00:29.600898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-3e3ef4f8-66ba-4cb8-b28e-67582a2f40e7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for user 3a0657648d244f12ab76c068b38e641b and project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'key_pairs'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:00:29.631110 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3e3ef4f8-66ba-4cb8-b28e-67582a2f40e7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.251298 Oct 14 18:00:29.636645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 331/653] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Oct 14 18:00:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:30.090581 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-683d5ffb-34ce-43c4-a865-261544460677 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:30.091198 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-683d5ffb-34ce-43c4-a865-261544460677 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:30.096645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:30.099506 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-683d5ffb-34ce-43c4-a865-261544460677 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:30.100192 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-683d5ffb-34ce-43c4-a865-261544460677 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:30.100781 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-683d5ffb-34ce-43c4-a865-261544460677 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:30.101845 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-683d5ffb-34ce-43c4-a865-261544460677 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:30.102472 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-683d5ffb-34ce-43c4-a865-261544460677 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:30.103057 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-683d5ffb-34ce-43c4-a865-261544460677 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:30.158515 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=8 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:30.275620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-683d5ffb-34ce-43c4-a865-261544460677 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:30.284231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-683d5ffb-34ce-43c4-a865-261544460677 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1264 microversion: 2.1 time: 0.197367 Oct 14 18:00:30.284961 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 323/654] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:30 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:31.308136 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e3af2f1f-c0cb-4359-8a67-a22e1ef262a8 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:31.308752 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e3af2f1f-c0cb-4359-8a67-a22e1ef262a8 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:31.315939 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3af2f1f-c0cb-4359-8a67-a22e1ef262a8 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:31.316482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3af2f1f-c0cb-4359-8a67-a22e1ef262a8 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:31.316910 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3af2f1f-c0cb-4359-8a67-a22e1ef262a8 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:31.317607 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3af2f1f-c0cb-4359-8a67-a22e1ef262a8 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:31.318052 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3af2f1f-c0cb-4359-8a67-a22e1ef262a8 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:31.318467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e3af2f1f-c0cb-4359-8a67-a22e1ef262a8 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:31.653539 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e3af2f1f-c0cb-4359-8a67-a22e1ef262a8 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:31.662258 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e3af2f1f-c0cb-4359-8a67-a22e1ef262a8 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1264 microversion: 2.1 time: 0.358581 Oct 14 18:00:31.676692 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 332/655] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:31 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1264 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:32.315695 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1471004347", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2dc29fa6-a064-4dfe-be69-6fc039570894"}], "security_groups": [{"name": "tempest-securitygroup--608005524"}], "key_name": "tempest-keypair-801541812", "user_data": "}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:32.510560 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.network.neutron [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] validate_networks() for [('2dc29fa6-a064-4dfe-be69-6fc039570894', None, None, None, None, None)] {{(pid=118656) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 18:00:32.686697 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-fed327f9-4d28-4e0e-8293-5bf3b7dab2f4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:32.687442 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-fed327f9-4d28-4e0e-8293-5bf3b7dab2f4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:32.695183 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fed327f9-4d28-4e0e-8293-5bf3b7dab2f4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:32.700652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fed327f9-4d28-4e0e-8293-5bf3b7dab2f4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:32.701341 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fed327f9-4d28-4e0e-8293-5bf3b7dab2f4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:32.702512 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fed327f9-4d28-4e0e-8293-5bf3b7dab2f4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:32.703163 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fed327f9-4d28-4e0e-8293-5bf3b7dab2f4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:32.703915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fed327f9-4d28-4e0e-8293-5bf3b7dab2f4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:33.025024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-fed327f9-4d28-4e0e-8293-5bf3b7dab2f4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:33.034695 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-fed327f9-4d28-4e0e-8293-5bf3b7dab2f4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1264 microversion: 2.1 time: 0.352362 Oct 14 18:00:33.035275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 333/656] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:32 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1264 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:00:33.082634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Flavor limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 18:00:33.083060 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Image limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 18:00:33.083581 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Flavor pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 18:00:33.084070 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Image pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 18:00:33.084704 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 18:00:33.093715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:33.094208 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:33.094673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:33.095398 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:33.096065 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:33.096495 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:33.113529 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:00:33.117616 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for user 3a0657648d244f12ab76c068b38e641b and project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:00:33.129209 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Going to run 1 instances... {{(pid=118656) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 18:00:33.131795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118656) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 18:00:33.185718 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8e6575b7-af0b-441b-9de0-e41ff9b902dd tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.875185 Oct 14 18:00:33.187208 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 324/657] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 18:00:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 18:00:33.199404 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b39f5607-046d-441e-894d-f78206378432 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:33.200453 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b39f5607-046d-441e-894d-f78206378432 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:33.270159 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b39f5607-046d-441e-894d-f78206378432 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:33.281556 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b39f5607-046d-441e-894d-f78206378432 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1241 microversion: 2.1 time: 0.086880 Oct 14 18:00:33.296024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 334/658] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:33 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:33.601226 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1908471f-92c5-4871-ad3b-ed4ccc3f75e0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:33.601945 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1908471f-92c5-4871-ad3b-ed4ccc3f75e0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:33.611815 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1908471f-92c5-4871-ad3b-ed4ccc3f75e0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:33.612368 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1908471f-92c5-4871-ad3b-ed4ccc3f75e0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:33.612827 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1908471f-92c5-4871-ad3b-ed4ccc3f75e0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:33.613879 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1908471f-92c5-4871-ad3b-ed4ccc3f75e0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:33.614932 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1908471f-92c5-4871-ad3b-ed4ccc3f75e0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:33.615962 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1908471f-92c5-4871-ad3b-ed4ccc3f75e0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:33.643519 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1908471f-92c5-4871-ad3b-ed4ccc3f75e0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/ips" status: 200 len: 152 microversion: 2.20 time: 0.405992 Oct 14 18:00:33.644792 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 325/659] 10.222.0.27 () {60 vars in 1289 bytes} [Fri Oct 14 18:00:33 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/ips => generated 152 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 18:00:34.057886 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5b5cf553-ded2-47a7-857b-eaee0e113e75 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:34.058498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5b5cf553-ded2-47a7-857b-eaee0e113e75 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:34.066277 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5b5cf553-ded2-47a7-857b-eaee0e113e75 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:34.066732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5b5cf553-ded2-47a7-857b-eaee0e113e75 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:34.067169 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5b5cf553-ded2-47a7-857b-eaee0e113e75 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:34.067933 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5b5cf553-ded2-47a7-857b-eaee0e113e75 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:34.068383 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5b5cf553-ded2-47a7-857b-eaee0e113e75 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:34.068976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5b5cf553-ded2-47a7-857b-eaee0e113e75 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:34.215171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5b5cf553-ded2-47a7-857b-eaee0e113e75 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:34.224479 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5b5cf553-ded2-47a7-857b-eaee0e113e75 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1264 microversion: 2.1 time: 0.170430 Oct 14 18:00:34.240976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 335/660] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:34 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:34.310732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c262c838-a825-4f95-81a5-f2caf5677c64 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:34.312906 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c262c838-a825-4f95-81a5-f2caf5677c64 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:34.319392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c262c838-a825-4f95-81a5-f2caf5677c64 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:34.320154 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c262c838-a825-4f95-81a5-f2caf5677c64 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:34.320589 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c262c838-a825-4f95-81a5-f2caf5677c64 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:34.321452 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c262c838-a825-4f95-81a5-f2caf5677c64 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:34.322243 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c262c838-a825-4f95-81a5-f2caf5677c64 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:34.322664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c262c838-a825-4f95-81a5-f2caf5677c64 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:34.394787 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c262c838-a825-4f95-81a5-f2caf5677c64 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:34.405320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c262c838-a825-4f95-81a5-f2caf5677c64 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1293 microversion: 2.1 time: 0.099061 Oct 14 18:00:34.405909 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 326/661] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:34 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:34.776265 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-6cdf6e09-c6ec-423c-9084-01580ce92119 req-48a7862d-628c-4a9f-a473-75aeb1b28247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2a9478-c81a-49f6-9176-c90b6e15466f", "name": "network-vif-plugged", "status": "completed", "tag": "7e54b253-263a-42cf-8f31-9f4a5d1746bc"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:34.792503 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-6cdf6e09-c6ec-423c-9084-01580ce92119 req-48a7862d-628c-4a9f-a473-75aeb1b28247 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:34.792956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-6cdf6e09-c6ec-423c-9084-01580ce92119 req-48a7862d-628c-4a9f-a473-75aeb1b28247 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:34.793464 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-6cdf6e09-c6ec-423c-9084-01580ce92119 req-48a7862d-628c-4a9f-a473-75aeb1b28247 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:34.813249 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-6cdf6e09-c6ec-423c-9084-01580ce92119 req-48a7862d-628c-4a9f-a473-75aeb1b28247 service nova] Creating event network-vif-plugged:7e54b253-263a-42cf-8f31-9f4a5d1746bc for instance fd2a9478-c81a-49f6-9176-c90b6e15466f on hv-cinder-74915 Oct 14 18:00:34.818682 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-6cdf6e09-c6ec-423c-9084-01580ce92119 req-48a7862d-628c-4a9f-a473-75aeb1b28247 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047280 Oct 14 18:00:34.819535 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 336/662] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:35.247860 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-6a5fbc03-2d62-45d7-b0e5-b3bc178c44da tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:35.249279 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-6a5fbc03-2d62-45d7-b0e5-b3bc178c44da tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:35.256210 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a5fbc03-2d62-45d7-b0e5-b3bc178c44da tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:35.256694 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a5fbc03-2d62-45d7-b0e5-b3bc178c44da tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:35.257120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a5fbc03-2d62-45d7-b0e5-b3bc178c44da tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:35.258053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a5fbc03-2d62-45d7-b0e5-b3bc178c44da tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:35.258574 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a5fbc03-2d62-45d7-b0e5-b3bc178c44da tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:35.259026 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6a5fbc03-2d62-45d7-b0e5-b3bc178c44da tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:35.430227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8984473b-4712-4809-8e28-b37acfff3787 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:35.431078 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8984473b-4712-4809-8e28-b37acfff3787 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:35.437349 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:35.439231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8984473b-4712-4809-8e28-b37acfff3787 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:35.439689 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8984473b-4712-4809-8e28-b37acfff3787 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:35.440557 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8984473b-4712-4809-8e28-b37acfff3787 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:35.441340 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8984473b-4712-4809-8e28-b37acfff3787 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:35.441823 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8984473b-4712-4809-8e28-b37acfff3787 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:35.442301 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8984473b-4712-4809-8e28-b37acfff3787 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:35.482628 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6a5fbc03-2d62-45d7-b0e5-b3bc178c44da tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:35.498031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-6a5fbc03-2d62-45d7-b0e5-b3bc178c44da tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1264 microversion: 2.1 time: 0.254085 Oct 14 18:00:35.498804 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 327/663] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:35 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1264 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:35.512603 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-18b7ebd4-f73e-4a70-a7c0-bcc75b759b79 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:35.515142 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-18b7ebd4-f73e-4a70-a7c0-bcc75b759b79 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:35.523656 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b7ebd4-f73e-4a70-a7c0-bcc75b759b79 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:35.524457 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b7ebd4-f73e-4a70-a7c0-bcc75b759b79 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:35.525086 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b7ebd4-f73e-4a70-a7c0-bcc75b759b79 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:35.526008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b7ebd4-f73e-4a70-a7c0-bcc75b759b79 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:35.526674 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b7ebd4-f73e-4a70-a7c0-bcc75b759b79 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:35.527271 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-18b7ebd4-f73e-4a70-a7c0-bcc75b759b79 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:35.557684 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-18b7ebd4-f73e-4a70-a7c0-bcc75b759b79 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lazy-loading 'flavor' on Instance uuid fc764f20-1f93-4e6d-ac1a-588f161d6ee5 {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:00:35.679710 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:35.722039 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8984473b-4712-4809-8e28-b37acfff3787 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:35.730426 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8984473b-4712-4809-8e28-b37acfff3787 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1366 microversion: 2.1 time: 0.304653 Oct 14 18:00:35.731456 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 337/664] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:35 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:35.859459 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-18b7ebd4-f73e-4a70-a7c0-bcc75b759b79 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "POST /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/action" status: 202 len: 0 microversion: 2.20 time: 0.357339 Oct 14 18:00:35.860181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 328/665] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Oct 14 18:00:35 2022] POST /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:00:35.869417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:35.870025 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:35.877188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:35.877667 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:35.878271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:35.878964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:35.879409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:35.879823 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:36.100965 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:36.106661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:36.116981 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:36.119221 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:36.125108 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-67dd79af-3887-4034-97fb-e83b44f35b64 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.260398 Oct 14 18:00:36.137455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 338/666] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:35 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 18:00:36.522661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-be9ad16a-63fe-4334-b172-d0a2b4df14ff tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:36.523367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-be9ad16a-63fe-4334-b172-d0a2b4df14ff tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:36.534066 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-be9ad16a-63fe-4334-b172-d0a2b4df14ff tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:36.534560 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-be9ad16a-63fe-4334-b172-d0a2b4df14ff tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:36.535183 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-be9ad16a-63fe-4334-b172-d0a2b4df14ff tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:36.536006 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-be9ad16a-63fe-4334-b172-d0a2b4df14ff tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:36.536377 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-be9ad16a-63fe-4334-b172-d0a2b4df14ff tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:36.536814 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-be9ad16a-63fe-4334-b172-d0a2b4df14ff tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:36.755356 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-edc8b852-93dc-40f1-937f-64fb528d6e27 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:36.758080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-edc8b852-93dc-40f1-937f-64fb528d6e27 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:36.770268 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-be9ad16a-63fe-4334-b172-d0a2b4df14ff tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:36.775715 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-edc8b852-93dc-40f1-937f-64fb528d6e27 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:36.777060 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-edc8b852-93dc-40f1-937f-64fb528d6e27 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:36.777942 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-edc8b852-93dc-40f1-937f-64fb528d6e27 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:36.779455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-edc8b852-93dc-40f1-937f-64fb528d6e27 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:36.783255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-edc8b852-93dc-40f1-937f-64fb528d6e27 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:36.784468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-edc8b852-93dc-40f1-937f-64fb528d6e27 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:36.785117 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-be9ad16a-63fe-4334-b172-d0a2b4df14ff tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1450 microversion: 2.1 time: 0.267128 Oct 14 18:00:36.786037 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 329/667] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:36 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1450 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:36.813826 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-097165d2-c869-4e8e-aef6-e678e7d2dfcd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:36.814439 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-097165d2-c869-4e8e-aef6-e678e7d2dfcd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:36.824081 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-097165d2-c869-4e8e-aef6-e678e7d2dfcd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:36.824813 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-097165d2-c869-4e8e-aef6-e678e7d2dfcd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:36.825552 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-097165d2-c869-4e8e-aef6-e678e7d2dfcd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:36.826398 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-097165d2-c869-4e8e-aef6-e678e7d2dfcd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:36.827534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-097165d2-c869-4e8e-aef6-e678e7d2dfcd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:36.828048 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-097165d2-c869-4e8e-aef6-e678e7d2dfcd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:37.068026 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-edc8b852-93dc-40f1-937f-64fb528d6e27 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:37.083960 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-edc8b852-93dc-40f1-937f-64fb528d6e27 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1366 microversion: 2.1 time: 0.332200 Oct 14 18:00:37.085289 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 339/668] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:36 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:37.106923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-ae550d58-b677-482e-859d-34cb5daba517 req-c24d5146-e301-40ba-a7ba-5fc713fe5e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bbbe808-1a08-42f9-b3eb-101761f16451", "tag": "224c20a8-d471-41aa-9fb6-c77acab8e577"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:37.116498 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-097165d2-c869-4e8e-aef6-e678e7d2dfcd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:37.120902 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-ae550d58-b677-482e-859d-34cb5daba517 req-c24d5146-e301-40ba-a7ba-5fc713fe5e3d service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:37.121787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-ae550d58-b677-482e-859d-34cb5daba517 req-c24d5146-e301-40ba-a7ba-5fc713fe5e3d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:37.122419 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-ae550d58-b677-482e-859d-34cb5daba517 req-c24d5146-e301-40ba-a7ba-5fc713fe5e3d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:37.128787 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-097165d2-c869-4e8e-aef6-e678e7d2dfcd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1450 microversion: 2.1 time: 0.320120 Oct 14 18:00:37.130167 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 330/669] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:36 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1450 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:37.138485 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-ae550d58-b677-482e-859d-34cb5daba517 req-c24d5146-e301-40ba-a7ba-5fc713fe5e3d service nova] Creating event network-changed:224c20a8-d471-41aa-9fb6-c77acab8e577 for instance 8bbbe808-1a08-42f9-b3eb-101761f16451 on hv-cinder-74915 Oct 14 18:00:37.144493 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-ae550d58-b677-482e-859d-34cb5daba517 req-c24d5146-e301-40ba-a7ba-5fc713fe5e3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041694 Oct 14 18:00:37.145845 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 340/670] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:00:37.158475 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:37.159098 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:37.166989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:37.168737 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:37.169659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:37.171214 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:37.171695 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:37.172469 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:37.449086 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:37.458669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:37.460160 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:37.461339 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-33a78da5-7bd7-4a06-9776-95666654c5f8 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.310860 Oct 14 18:00:37.461908 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 331/671] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:37 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:38.110116 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-13810223-db72-4ff3-972c-b243d8ce1a0f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:38.110817 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-13810223-db72-4ff3-972c-b243d8ce1a0f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:38.117403 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13810223-db72-4ff3-972c-b243d8ce1a0f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:38.118103 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13810223-db72-4ff3-972c-b243d8ce1a0f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:38.118713 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13810223-db72-4ff3-972c-b243d8ce1a0f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:38.119604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13810223-db72-4ff3-972c-b243d8ce1a0f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:38.120105 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13810223-db72-4ff3-972c-b243d8ce1a0f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:38.120689 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-13810223-db72-4ff3-972c-b243d8ce1a0f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:38.465613 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-13810223-db72-4ff3-972c-b243d8ce1a0f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:38.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-13810223-db72-4ff3-972c-b243d8ce1a0f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1366 microversion: 2.1 time: 0.373154 Oct 14 18:00:38.479691 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 341/672] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:38 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:38.496093 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:38.496725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:38.502888 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:38.505118 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:38.506165 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:38.507076 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:38.507756 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:38.508488 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:39.137997 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:39.148145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:39.150358 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:39.151855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3bb460c6-9700-4c8a-ba99-7544e71552b3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.668234 Oct 14 18:00:39.164721 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 332/673] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:38 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:39.502046 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8f9b83d5-e368-4434-a5c7-9858ecbf4c75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:39.502656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8f9b83d5-e368-4434-a5c7-9858ecbf4c75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:39.510507 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f9b83d5-e368-4434-a5c7-9858ecbf4c75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:39.511227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f9b83d5-e368-4434-a5c7-9858ecbf4c75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:39.511831 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f9b83d5-e368-4434-a5c7-9858ecbf4c75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:39.512743 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f9b83d5-e368-4434-a5c7-9858ecbf4c75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:39.513348 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f9b83d5-e368-4434-a5c7-9858ecbf4c75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:39.513919 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8f9b83d5-e368-4434-a5c7-9858ecbf4c75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:39.860112 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8f9b83d5-e368-4434-a5c7-9858ecbf4c75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:39.871185 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8f9b83d5-e368-4434-a5c7-9858ecbf4c75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1366 microversion: 2.1 time: 0.372309 Oct 14 18:00:39.884202 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 342/674] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:39 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:40.184193 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:40.185559 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:40.196735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:40.198349 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:40.199072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:40.199665 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:40.200568 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:40.201219 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:40.201831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:40.477754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:40.486610 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:40.488092 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:40.517669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-58677adb-459e-4d34-acd5-4b62fb20067b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.312389 Oct 14 18:00:40.520648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 333/675] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:40 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:40.801686 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-3dd2d039-c683-4526-9f77-1460cd17dd46 req-2a9b38e5-338b-4d5a-9c0c-024451469673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2a9478-c81a-49f6-9176-c90b6e15466f", "tag": "7e54b253-263a-42cf-8f31-9f4a5d1746bc"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:40.823825 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-3dd2d039-c683-4526-9f77-1460cd17dd46 req-2a9b38e5-338b-4d5a-9c0c-024451469673 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:40.824335 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-3dd2d039-c683-4526-9f77-1460cd17dd46 req-2a9b38e5-338b-4d5a-9c0c-024451469673 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:40.827815 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-3dd2d039-c683-4526-9f77-1460cd17dd46 req-2a9b38e5-338b-4d5a-9c0c-024451469673 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:40.849925 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-3dd2d039-c683-4526-9f77-1460cd17dd46 req-2a9b38e5-338b-4d5a-9c0c-024451469673 service nova] Creating event network-changed:7e54b253-263a-42cf-8f31-9f4a5d1746bc for instance fd2a9478-c81a-49f6-9176-c90b6e15466f on hv-cinder-74915 Oct 14 18:00:40.862229 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-3dd2d039-c683-4526-9f77-1460cd17dd46 req-2a9b38e5-338b-4d5a-9c0c-024451469673 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065161 Oct 14 18:00:40.867750 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 343/676] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:40.895212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-6e3309d6-72fc-4d36-ace8-49d20f94238f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:40.905689 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-6e3309d6-72fc-4d36-ace8-49d20f94238f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:40.913832 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6e3309d6-72fc-4d36-ace8-49d20f94238f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:40.914815 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6e3309d6-72fc-4d36-ace8-49d20f94238f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:40.915468 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6e3309d6-72fc-4d36-ace8-49d20f94238f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:40.916370 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6e3309d6-72fc-4d36-ace8-49d20f94238f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:40.918439 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6e3309d6-72fc-4d36-ace8-49d20f94238f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:40.920182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6e3309d6-72fc-4d36-ace8-49d20f94238f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:41.338969 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6e3309d6-72fc-4d36-ace8-49d20f94238f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:41.352245 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-6e3309d6-72fc-4d36-ace8-49d20f94238f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1366 microversion: 2.1 time: 0.460907 Oct 14 18:00:41.353376 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 334/677] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:40 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:41.545137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:41.546217 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:41.558370 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:41.558370 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:41.559695 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:41.561713 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:41.564830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:41.565530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:41.832680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:41.846361 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:41.862393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:41.864213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e96f1ea3-f01f-4ddf-89f1-29b6bbb800f5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.323099 Oct 14 18:00:41.866019 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 344/678] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:41 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:42.384028 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-50c3bc74-87e4-4067-894f-c49c82253d3b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:42.397856 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-50c3bc74-87e4-4067-894f-c49c82253d3b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:42.405285 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50c3bc74-87e4-4067-894f-c49c82253d3b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:42.405957 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50c3bc74-87e4-4067-894f-c49c82253d3b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:42.407417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50c3bc74-87e4-4067-894f-c49c82253d3b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:42.408371 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50c3bc74-87e4-4067-894f-c49c82253d3b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:42.408995 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50c3bc74-87e4-4067-894f-c49c82253d3b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:42.409605 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50c3bc74-87e4-4067-894f-c49c82253d3b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:42.575447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-50c3bc74-87e4-4067-894f-c49c82253d3b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:42.601223 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-50c3bc74-87e4-4067-894f-c49c82253d3b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1366 microversion: 2.1 time: 0.229911 Oct 14 18:00:42.602084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 335/679] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:42 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:42.872795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-2db12cf2-272c-46d4-8428-e8d140574635 req-c5cc3a58-1e9a-412a-8598-157d947341ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bbbe808-1a08-42f9-b3eb-101761f16451", "name": "network-vif-plugged", "status": "completed", "tag": "224c20a8-d471-41aa-9fb6-c77acab8e577"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:42.893013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:42.893627 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:42.895576 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2db12cf2-272c-46d4-8428-e8d140574635 req-c5cc3a58-1e9a-412a-8598-157d947341ff service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:42.897000 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2db12cf2-272c-46d4-8428-e8d140574635 req-c5cc3a58-1e9a-412a-8598-157d947341ff service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:42.899158 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2db12cf2-272c-46d4-8428-e8d140574635 req-c5cc3a58-1e9a-412a-8598-157d947341ff service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:42.907519 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:42.908053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:42.908505 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:42.909222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:42.909684 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:42.910968 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:42.923273 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-2db12cf2-272c-46d4-8428-e8d140574635 req-c5cc3a58-1e9a-412a-8598-157d947341ff service nova] Creating event network-vif-plugged:224c20a8-d471-41aa-9fb6-c77acab8e577 for instance 8bbbe808-1a08-42f9-b3eb-101761f16451 on hv-cinder-74915 Oct 14 18:00:42.940438 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-2db12cf2-272c-46d4-8428-e8d140574635 req-c5cc3a58-1e9a-412a-8598-157d947341ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071542 Oct 14 18:00:42.941295 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 345/680] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:43.104334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:43.123527 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:43.127316 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=6 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:43.138769 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:43.141248 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:43.143115 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-6b511a96-bccd-4e5a-9b25-a96d8fc57763 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.255936 Oct 14 18:00:43.160857 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 336/681] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:42 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 18:00:43.627890 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:43.633964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-03b7e38c-446b-49cd-a167-279a128af1f3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:43.634731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-03b7e38c-446b-49cd-a167-279a128af1f3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:43.643665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03b7e38c-446b-49cd-a167-279a128af1f3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:43.649664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03b7e38c-446b-49cd-a167-279a128af1f3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:43.650219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03b7e38c-446b-49cd-a167-279a128af1f3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:43.651212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03b7e38c-446b-49cd-a167-279a128af1f3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:43.651957 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03b7e38c-446b-49cd-a167-279a128af1f3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:43.652606 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-03b7e38c-446b-49cd-a167-279a128af1f3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:44.019422 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-03b7e38c-446b-49cd-a167-279a128af1f3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:44.032031 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-03b7e38c-446b-49cd-a167-279a128af1f3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1366 microversion: 2.1 time: 0.404968 Oct 14 18:00:44.032814 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 346/682] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:43 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:44.180253 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:44.182555 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:44.192998 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:44.194778 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:44.195404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:44.196780 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:44.197408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:44.198168 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:44.459340 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:44.470569 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:44.472125 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:44.473310 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-427e68c7-a65d-40a6-a9bb-abda1242b675 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.304379 Oct 14 18:00:44.477964 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 337/683] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:44 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:45.060343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9f6642c2-3f87-4a4f-84a7-1f8a0f117150 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:45.060930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9f6642c2-3f87-4a4f-84a7-1f8a0f117150 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:45.071334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f6642c2-3f87-4a4f-84a7-1f8a0f117150 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:45.073338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f6642c2-3f87-4a4f-84a7-1f8a0f117150 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:45.074658 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f6642c2-3f87-4a4f-84a7-1f8a0f117150 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:45.077800 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f6642c2-3f87-4a4f-84a7-1f8a0f117150 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:45.078463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f6642c2-3f87-4a4f-84a7-1f8a0f117150 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:45.078898 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9f6642c2-3f87-4a4f-84a7-1f8a0f117150 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:45.237958 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4fd2e27d-9f66-415c-a4c0-cefd4b39a61a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:45.238533 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4fd2e27d-9f66-415c-a4c0-cefd4b39a61a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:45.244913 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd2e27d-9f66-415c-a4c0-cefd4b39a61a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:45.245394 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd2e27d-9f66-415c-a4c0-cefd4b39a61a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:45.245824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd2e27d-9f66-415c-a4c0-cefd4b39a61a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:45.246521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd2e27d-9f66-415c-a4c0-cefd4b39a61a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:45.246972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd2e27d-9f66-415c-a4c0-cefd4b39a61a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:45.247391 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4fd2e27d-9f66-415c-a4c0-cefd4b39a61a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:45.286348 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4fd2e27d-9f66-415c-a4c0-cefd4b39a61a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/ips" status: 200 len: 147 microversion: 2.1 time: 0.361771 Oct 14 18:00:45.286911 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 347/684] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Oct 14 18:00:44 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/ips => generated 147 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:45.390100 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-9f6642c2-3f87-4a4f-84a7-1f8a0f117150 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:45.398163 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9f6642c2-3f87-4a4f-84a7-1f8a0f117150 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1366 microversion: 2.1 time: 0.345441 Oct 14 18:00:45.413382 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 338/685] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:45 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:45.499957 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:45.500659 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:45.509053 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:45.510271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:45.511909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:45.515857 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:45.516158 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:45.516844 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:45.811049 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:45.833449 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:45.837409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:45.841888 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c8e1ec74-d4ee-4028-bd94-b6e2396e0d6a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.342922 Oct 14 18:00:45.859513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 348/686] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:45 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:46.356358 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-dd04c45b-66dd-4966-83c2-4114ec9b7d67 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Action: 'create', calling method: .version_select at 0x7fe3da5540d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-319776221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdCoUWFJ+19+VoVLgjdZlseux+fyEKwD23QpEIWrt37/u5hJY+7aA2/CWwBtvca1uObeXJI+P6svKi/JXllX3lHgxG4SI+s6ETPB5zzGU5yH4hs162MuD86NpSWO9mxGQ=="}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:46.374945 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-dd04c45b-66dd-4966-83c2-4114ec9b7d67 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Getting quotas for project 16610892c7d34b28a2ee5313a4bea23b. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:00:46.379208 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-dd04c45b-66dd-4966-83c2-4114ec9b7d67 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Getting quotas for user 74943fd4c96b43e8a32989e7ed74cdf2 and project 16610892c7d34b28a2ee5313a4bea23b. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:00:46.409414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-dd04c45b-66dd-4966-83c2-4114ec9b7d67 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.168652 Oct 14 18:00:46.410346 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 339/687] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Oct 14 18:00:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:46.420171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bfeb71ab-6948-4f36-95ed-48f21ce219d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:46.421287 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bfeb71ab-6948-4f36-95ed-48f21ce219d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:46.428287 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bfeb71ab-6948-4f36-95ed-48f21ce219d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:46.428764 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bfeb71ab-6948-4f36-95ed-48f21ce219d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:46.429203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bfeb71ab-6948-4f36-95ed-48f21ce219d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:46.429899 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bfeb71ab-6948-4f36-95ed-48f21ce219d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:46.430343 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bfeb71ab-6948-4f36-95ed-48f21ce219d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:46.430758 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bfeb71ab-6948-4f36-95ed-48f21ce219d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:46.649851 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bfeb71ab-6948-4f36-95ed-48f21ce219d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:46.677010 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bfeb71ab-6948-4f36-95ed-48f21ce219d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1557 microversion: 2.1 time: 0.260653 Oct 14 18:00:46.681342 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 349/688] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:00:46 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1557 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:00:46.706203 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1d706dd0-bfd8-4756-92ee-5cfd1a6e84da tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:46.706702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1d706dd0-bfd8-4756-92ee-5cfd1a6e84da tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:46.732136 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1d706dd0-bfd8-4756-92ee-5cfd1a6e84da tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:46.732675 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1d706dd0-bfd8-4756-92ee-5cfd1a6e84da tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:46.733662 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1d706dd0-bfd8-4756-92ee-5cfd1a6e84da tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:46.734645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1d706dd0-bfd8-4756-92ee-5cfd1a6e84da tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:46.736525 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1d706dd0-bfd8-4756-92ee-5cfd1a6e84da tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:46.737421 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1d706dd0-bfd8-4756-92ee-5cfd1a6e84da tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:46.869983 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:46.870511 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:46.878023 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1d706dd0-bfd8-4756-92ee-5cfd1a6e84da tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177179 Oct 14 18:00:46.881870 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:46.884316 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 340/689] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Oct 14 18:00:46 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:46.885040 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:46.885652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:46.887798 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:46.890530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3272def6-f1cc-4770-863c-c328c2becd97 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80f6f5ad-9335-49a8-a992-fc0338e0bb88"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:46.891015 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:46.891638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:46.893241 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3272def6-f1cc-4770-863c-c328c2becd97 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:46.906735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3272def6-f1cc-4770-863c-c328c2becd97 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:46.907487 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3272def6-f1cc-4770-863c-c328c2becd97 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:46.908420 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3272def6-f1cc-4770-863c-c328c2becd97 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:46.909650 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3272def6-f1cc-4770-863c-c328c2becd97 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:46.910465 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3272def6-f1cc-4770-863c-c328c2becd97 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:46.911056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3272def6-f1cc-4770-863c-c328c2becd97 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:47.107730 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:47.118017 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:47.119604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:47.120889 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-791b95bb-d2c8-415a-a300-db429d9df477 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.255006 Oct 14 18:00:47.121381 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 350/690] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:46 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 18:00:47.341427 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3272def6-f1cc-4770-863c-c328c2becd97 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453116 Oct 14 18:00:47.342310 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 341/691] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 18:00:46 2022] POST /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments => generated 194 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:48.159183 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:48.159746 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:48.176193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:48.176955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:48.187973 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:48.188791 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:48.190282 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:48.190880 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:48.393993 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-ddf7dd34-5d7f-4f85-ac72-faf0cbc8fa83 req-561d118a-7a6b-417b-87d6-477191c13b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bbbe808-1a08-42f9-b3eb-101761f16451", "tag": "224c20a8-d471-41aa-9fb6-c77acab8e577"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:48.419333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-ddf7dd34-5d7f-4f85-ac72-faf0cbc8fa83 req-561d118a-7a6b-417b-87d6-477191c13b4d service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:48.420079 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-ddf7dd34-5d7f-4f85-ac72-faf0cbc8fa83 req-561d118a-7a6b-417b-87d6-477191c13b4d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:48.421220 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-ddf7dd34-5d7f-4f85-ac72-faf0cbc8fa83 req-561d118a-7a6b-417b-87d6-477191c13b4d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:48.456301 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-ddf7dd34-5d7f-4f85-ac72-faf0cbc8fa83 req-561d118a-7a6b-417b-87d6-477191c13b4d service nova] Creating event network-changed:224c20a8-d471-41aa-9fb6-c77acab8e577 for instance 8bbbe808-1a08-42f9-b3eb-101761f16451 on hv-cinder-74915 Oct 14 18:00:48.473756 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-ddf7dd34-5d7f-4f85-ac72-faf0cbc8fa83 req-561d118a-7a6b-417b-87d6-477191c13b4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204390 Oct 14 18:00:48.474361 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 342/692] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:48.551622 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:48.563754 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:48.569178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:48.570593 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f0b79b90-e035-49dc-ba73-43dd20212532 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.424395 Oct 14 18:00:48.585378 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 351/693] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:48 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:49.609973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:49.610741 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:49.619619 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:49.620817 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:49.621445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:49.622610 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:49.623225 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:49.624062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:49.789816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:49.799726 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:49.801478 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:49.802714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8da13a0c-5ca0-452e-adab-c9e7b913d339 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.198424 Oct 14 18:00:49.803978 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 343/694] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:49 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:50.828912 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:50.829750 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:50.836653 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:50.837254 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:50.837867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:50.838898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:50.839681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:50.840198 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:50.991702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:51.001537 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:51.003229 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:51.004601 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-805d18be-eac5-4bba-a147-d2e9f27a1c3a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.180161 Oct 14 18:00:51.005365 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 352/695] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:50 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:52.032491 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:52.033072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:52.039495 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:52.040001 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:52.040435 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:52.041112 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:52.041559 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:52.041975 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:52.177720 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:52.188195 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:52.189627 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:52.190805 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-55e87e46-8890-4cbf-8fa0-b38d1fcddd8b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1746 microversion: 2.20 time: 0.162769 Oct 14 18:00:52.191360 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 344/696] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:52 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:53.215390 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:53.216012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:53.222802 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:53.223277 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:53.223704 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:53.224406 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:53.224848 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:53.225263 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:53.359826 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:53.368028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:53.369494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:53.370640 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-1ecc5915-e657-497f-b6f2-11c36138abbc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1746 microversion: 2.20 time: 0.159070 Oct 14 18:00:53.371190 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 353/697] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:53 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:54.396388 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:54.397074 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:54.403559 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:54.404184 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:54.404692 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:54.405525 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:54.406020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:54.406443 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:54.550761 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:54.559528 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:54.561523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:54.562167 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c83037b5-cbeb-4d90-b1b6-4e0c209195b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1741 microversion: 2.20 time: 0.169602 Oct 14 18:00:54.563837 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 345/698] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:54 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:54.803503 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-35b9afb2-2c0e-4ddd-a490-30cec6869453 req-0f06f3bd-030e-4205-a297-bd13246b646a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc764f20-1f93-4e6d-ac1a-588f161d6ee5", "name": "network-vif-plugged", "status": "completed", "tag": "8a708001-7ad4-4eed-9fae-7d4dbab749c6"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:54.813481 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-35b9afb2-2c0e-4ddd-a490-30cec6869453 req-0f06f3bd-030e-4205-a297-bd13246b646a service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:54.813958 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-35b9afb2-2c0e-4ddd-a490-30cec6869453 req-0f06f3bd-030e-4205-a297-bd13246b646a service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:54.814389 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-35b9afb2-2c0e-4ddd-a490-30cec6869453 req-0f06f3bd-030e-4205-a297-bd13246b646a service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:54.827067 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-35b9afb2-2c0e-4ddd-a490-30cec6869453 req-0f06f3bd-030e-4205-a297-bd13246b646a service nova] Creating event network-vif-plugged:8a708001-7ad4-4eed-9fae-7d4dbab749c6 for instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 on hv-cinder-74915 Oct 14 18:00:54.839713 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-35b9afb2-2c0e-4ddd-a490-30cec6869453 req-0f06f3bd-030e-4205-a297-bd13246b646a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140790 Oct 14 18:00:54.840624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 354/699] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:55.042081 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3206d202-16c8-4eff-98b3-0142b85c011e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:55.044905 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3206d202-16c8-4eff-98b3-0142b85c011e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:55.058530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3206d202-16c8-4eff-98b3-0142b85c011e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:55.059329 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3206d202-16c8-4eff-98b3-0142b85c011e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:55.059765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3206d202-16c8-4eff-98b3-0142b85c011e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:55.060500 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3206d202-16c8-4eff-98b3-0142b85c011e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:55.060961 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3206d202-16c8-4eff-98b3-0142b85c011e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:55.061556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3206d202-16c8-4eff-98b3-0142b85c011e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:55.066721 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:55.095647 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3206d202-16c8-4eff-98b3-0142b85c011e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057358 Oct 14 18:00:55.101782 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 346/700] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:00:55 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:55.108004 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3233ffe4-13f7-4fa9-8717-f2dba83c2fd8 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:55.108869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3233ffe4-13f7-4fa9-8717-f2dba83c2fd8 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:55.116219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3233ffe4-13f7-4fa9-8717-f2dba83c2fd8 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:55.116937 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3233ffe4-13f7-4fa9-8717-f2dba83c2fd8 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:55.117550 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3233ffe4-13f7-4fa9-8717-f2dba83c2fd8 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:55.118253 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3233ffe4-13f7-4fa9-8717-f2dba83c2fd8 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:55.118707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3233ffe4-13f7-4fa9-8717-f2dba83c2fd8 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:55.119135 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3233ffe4-13f7-4fa9-8717-f2dba83c2fd8 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:55.165589 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3233ffe4-13f7-4fa9-8717-f2dba83c2fd8 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments/80f6f5ad-9335-49a8-a992-fc0338e0bb88" status: 200 len: 194 microversion: 2.1 time: 0.062195 Oct 14 18:00:55.166508 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 355/701] 10.222.0.27 () {58 vars in 1413 bytes} [Fri Oct 14 18:00:55 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments/80f6f5ad-9335-49a8-a992-fc0338e0bb88 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:55.589314 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:55.589923 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:55.597398 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:55.597877 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:55.598298 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:55.599175 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:55.599618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:55.600072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:55.766294 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:55.774396 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:55.776151 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:55.778313 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-014cfab5-f4d4-40b3-b5d6-d827ab2c6be3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1741 microversion: 2.20 time: 0.193263 Oct 14 18:00:55.798464 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 347/702] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:55 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:56.587328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a8b79d8d-99f7-45ab-8667-2efbfec87296 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa16beaa-34f3-47d0-b666-5b800174fe57"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:00:56.589854 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a8b79d8d-99f7-45ab-8667-2efbfec87296 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:56.598419 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a8b79d8d-99f7-45ab-8667-2efbfec87296 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:56.598794 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a8b79d8d-99f7-45ab-8667-2efbfec87296 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:56.599238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a8b79d8d-99f7-45ab-8667-2efbfec87296 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:56.599985 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a8b79d8d-99f7-45ab-8667-2efbfec87296 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:56.604336 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a8b79d8d-99f7-45ab-8667-2efbfec87296 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:56.604336 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a8b79d8d-99f7-45ab-8667-2efbfec87296 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:56.806734 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:56.808053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:56.811287 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=4 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:56.818556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:56.819088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:56.819664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:56.820627 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:56.821229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:56.821717 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:56.909607 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a8b79d8d-99f7-45ab-8667-2efbfec87296 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "POST /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325864 Oct 14 18:00:56.910401 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 356/703] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 18:00:56 2022] POST /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:00:57.033612 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:57.044024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:57.046644 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:57.052443 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-afc0098a-9861-4391-ad4d-dcabad962c77 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1741 microversion: 2.20 time: 0.249492 Oct 14 18:00:57.054201 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 348/704] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:56 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:58.081671 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:58.082595 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:58.089547 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:58.090025 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:58.090760 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:58.091462 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:58.091956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:58.092380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:58.116522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:58.253935 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:58.263036 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:58.264572 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:58.267149 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6cc55491-27ce-48b3-a02a-94125ec0c927 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1741 microversion: 2.20 time: 0.189808 Oct 14 18:00:58.267813 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 357/705] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:58 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:00:59.295275 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:00:59.298228 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:00:59.308648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:59.308648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:59.308648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:59.308648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:00:59.309636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:00:59.309636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:00:59.469486 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:59.478781 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:59.480263 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:00:59.481430 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a89e7f86-e34d-40c7-83f6-8ab282a0b421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1741 microversion: 2.20 time: 0.190058 Oct 14 18:00:59.484290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 349/706] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:00:59 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:00.508667 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:00.509966 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:00.517722 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:00.518281 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:00.519093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:00.519830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:00.520306 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:00.520727 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:00.687399 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:00.696062 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:00.698621 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:00.700367 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-db8da0aa-911f-4ade-a132-36564b5d135f tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1741 microversion: 2.20 time: 0.195611 Oct 14 18:01:00.716031 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 358/707] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:00 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:01.728490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:01.729266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:01.736731 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:01.737355 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:01.737894 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:01.738962 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:01.739627 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:01.740199 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:01.919051 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:01.927901 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:01.929354 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:01.930531 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d3eaf107-88c2-42ef-8237-8a622fdfe764 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1741 microversion: 2.20 time: 0.206122 Oct 14 18:01:01.931168 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 350/708] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:01 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:02.960771 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:02.961393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:02.968226 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:02.968719 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:02.969387 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:02.970274 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:02.970731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:02.971206 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:03.133043 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:03.143336 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:03.145063 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:03.146165 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9d8b7581-fc96-43e4-b589-fa624cbe6559 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1741 microversion: 2.20 time: 0.189376 Oct 14 18:01:03.146723 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 359/709] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:02 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:04.175305 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:04.175930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:04.182248 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:04.182725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:04.183156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:04.183836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:04.184318 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:04.184735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:04.314037 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:04.321996 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:04.323693 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:04.324637 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-75fb8514-f19d-49fd-88c6-4edc2ffa55af tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1741 microversion: 2.20 time: 0.153986 Oct 14 18:01:04.325189 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 351/710] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:04 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:04.527510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f6cae360-f948-47dd-baaa-a06a8dd2e5d7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:04.529974 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f6cae360-f948-47dd-baaa-a06a8dd2e5d7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:04.538217 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f6cae360-f948-47dd-baaa-a06a8dd2e5d7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:04.538697 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f6cae360-f948-47dd-baaa-a06a8dd2e5d7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:04.539128 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f6cae360-f948-47dd-baaa-a06a8dd2e5d7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:04.539816 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f6cae360-f948-47dd-baaa-a06a8dd2e5d7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:04.540293 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f6cae360-f948-47dd-baaa-a06a8dd2e5d7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:04.540712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f6cae360-f948-47dd-baaa-a06a8dd2e5d7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:04.570250 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f6cae360-f948-47dd-baaa-a06a8dd2e5d7 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047139 Oct 14 18:01:04.570733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 360/711] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:01:04 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:04.717554 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ea5106d5-eb44-4987-860e-3e717af665b2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:04.718055 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ea5106d5-eb44-4987-860e-3e717af665b2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:04.725057 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ea5106d5-eb44-4987-860e-3e717af665b2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:04.725540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ea5106d5-eb44-4987-860e-3e717af665b2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:04.725972 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ea5106d5-eb44-4987-860e-3e717af665b2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:04.726654 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ea5106d5-eb44-4987-860e-3e717af665b2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:04.727106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ea5106d5-eb44-4987-860e-3e717af665b2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:04.727531 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ea5106d5-eb44-4987-860e-3e717af665b2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:04.755778 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ea5106d5-eb44-4987-860e-3e717af665b2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments/80f6f5ad-9335-49a8-a992-fc0338e0bb88" status: 200 len: 194 microversion: 2.1 time: 0.042102 Oct 14 18:01:04.756415 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 352/712] 10.222.0.27 () {58 vars in 1413 bytes} [Fri Oct 14 18:01:04 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments/80f6f5ad-9335-49a8-a992-fc0338e0bb88 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:04.767273 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9ab0dafc-df80-4f64-aec9-c58c1df9045c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:04.767897 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9ab0dafc-df80-4f64-aec9-c58c1df9045c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:04.773796 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ab0dafc-df80-4f64-aec9-c58c1df9045c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:04.774269 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ab0dafc-df80-4f64-aec9-c58c1df9045c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:04.774695 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ab0dafc-df80-4f64-aec9-c58c1df9045c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:04.775413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ab0dafc-df80-4f64-aec9-c58c1df9045c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:04.775862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ab0dafc-df80-4f64-aec9-c58c1df9045c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:04.776302 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9ab0dafc-df80-4f64-aec9-c58c1df9045c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:04.862258 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-9ab0dafc-df80-4f64-aec9-c58c1df9045c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lazy-loading 'services' on Instance uuid 557fb52b-468d-475a-a26d-71d7975ef533 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:01:04.899722 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-608701664", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-319776221", "security_groups": [{"name": "tempest-secgroup-smoke-479642386"}], "networks": [{"uuid": "189bc153-c094-4155-88a3-9296df03396a"}], "block_device_mapping_v2": [{"uuid": "44752735-eec6-4145-a52f-30558bbe28fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:04.940100 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9ab0dafc-df80-4f64-aec9-c58c1df9045c tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments/80f6f5ad-9335-49a8-a992-fc0338e0bb88" status: 202 len: 0 microversion: 2.1 time: 0.177091 Oct 14 18:01:04.941118 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 361/713] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 18:01:04 2022] DELETE /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments/80f6f5ad-9335-49a8-a992-fc0338e0bb88 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:01:05.065857 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.network.neutron [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] validate_networks() for [('189bc153-c094-4155-88a3-9296df03396a', None, None, None, None, None)] {{(pid=118656) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 18:01:05.353719 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:05.354407 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:05.361776 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:05.362257 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:05.362683 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:05.363369 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:05.363811 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:05.364248 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:05.521849 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Flavor limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 18:01:05.522345 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Image limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 18:01:05.522730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Flavor pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 18:01:05.523163 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Image pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 18:01:05.523569 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 18:01:05.532777 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:05.533257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:05.533687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:05.534408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:05.534854 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:05.535277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:05.552324 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Getting quotas for project 16610892c7d34b28a2ee5313a4bea23b. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:01:05.556273 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Getting quotas for user 74943fd4c96b43e8a32989e7ed74cdf2 and project 16610892c7d34b28a2ee5313a4bea23b. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:01:05.587310 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:05.596416 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:05.597939 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:05.599174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-23009efc-3d61-477d-8f02-4fdec670398a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1723 microversion: 2.20 time: 0.249703 Oct 14 18:01:05.599811 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 362/714] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:05 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 18:01:05.614452 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Going to run 1 instances... {{(pid=118656) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 18:01:05.616754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44752735-eec6-4145-a52f-30558bbe28fa',volume_size=None,volume_type=None)] {{(pid=118656) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 18:01:05.744438 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-919a7c6a-7bc6-4b83-a5e4-d6f931ec7a0b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.850625 Oct 14 18:01:05.745077 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 353/715] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 18:01:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 18:01:05.756483 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9ed58cc9-40da-4bfa-a1e1-f67e10b78f75 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:05.757155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9ed58cc9-40da-4bfa-a1e1-f67e10b78f75 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:05.777648 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=52 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:05.844115 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9ed58cc9-40da-4bfa-a1e1-f67e10b78f75 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:05.852501 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9ed58cc9-40da-4bfa-a1e1-f67e10b78f75 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1087 microversion: 2.1 time: 0.099357 Oct 14 18:01:05.853070 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 363/716] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:05 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1087 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:06.071259 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8673eeba-72e3-481f-b529-75f2b6fbcf37 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:06.071782 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8673eeba-72e3-481f-b529-75f2b6fbcf37 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:06.077757 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8673eeba-72e3-481f-b529-75f2b6fbcf37 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:06.078846 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8673eeba-72e3-481f-b529-75f2b6fbcf37 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:06.079322 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8673eeba-72e3-481f-b529-75f2b6fbcf37 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:06.080059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8673eeba-72e3-481f-b529-75f2b6fbcf37 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:06.080521 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8673eeba-72e3-481f-b529-75f2b6fbcf37 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:06.080947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8673eeba-72e3-481f-b529-75f2b6fbcf37 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:06.110438 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8673eeba-72e3-481f-b529-75f2b6fbcf37 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments/fa16beaa-34f3-47d0-b666-5b800174fe57" status: 200 len: 194 microversion: 2.1 time: 0.042968 Oct 14 18:01:06.111037 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 354/717] 10.222.0.27 () {58 vars in 1413 bytes} [Fri Oct 14 18:01:06 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments/fa16beaa-34f3-47d0-b666-5b800174fe57 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:01:06.121594 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-091baec2-41d7-47b7-b31b-280c68b82ec0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:06.122089 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-091baec2-41d7-47b7-b31b-280c68b82ec0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:06.129060 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-091baec2-41d7-47b7-b31b-280c68b82ec0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:06.129547 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-091baec2-41d7-47b7-b31b-280c68b82ec0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:06.129983 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-091baec2-41d7-47b7-b31b-280c68b82ec0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:06.130679 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-091baec2-41d7-47b7-b31b-280c68b82ec0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:06.131148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-091baec2-41d7-47b7-b31b-280c68b82ec0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:06.131564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-091baec2-41d7-47b7-b31b-280c68b82ec0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:06.217102 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-091baec2-41d7-47b7-b31b-280c68b82ec0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lazy-loading 'services' on Instance uuid 557fb52b-468d-475a-a26d-71d7975ef533 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:01:06.288411 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-091baec2-41d7-47b7-b31b-280c68b82ec0 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments/fa16beaa-34f3-47d0-b666-5b800174fe57" status: 202 len: 0 microversion: 2.1 time: 0.170402 Oct 14 18:01:06.288931 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 364/718] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 18:01:06 2022] DELETE /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments/fa16beaa-34f3-47d0-b666-5b800174fe57 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:01:06.625013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:06.625660 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:06.631917 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:06.632405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:06.632838 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:06.633526 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:06.633981 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:06.634402 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:06.763463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:06.771690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:06.773171 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:06.774324 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-409e553d-cb28-4c08-b581-db65138e56b9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1723 microversion: 2.20 time: 0.153174 Oct 14 18:01:06.774885 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 355/719] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:06 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:06.875807 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f9c12b5e-a655-4713-a444-c38643f2e958 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:06.876578 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f9c12b5e-a655-4713-a444-c38643f2e958 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:06.882683 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9c12b5e-a655-4713-a444-c38643f2e958 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:06.883138 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9c12b5e-a655-4713-a444-c38643f2e958 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:06.883566 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9c12b5e-a655-4713-a444-c38643f2e958 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:06.884274 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9c12b5e-a655-4713-a444-c38643f2e958 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:06.884720 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9c12b5e-a655-4713-a444-c38643f2e958 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:06.885134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9c12b5e-a655-4713-a444-c38643f2e958 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:06.946825 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f9c12b5e-a655-4713-a444-c38643f2e958 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:06.954608 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f9c12b5e-a655-4713-a444-c38643f2e958 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1137 microversion: 2.1 time: 0.084079 Oct 14 18:01:06.955162 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 365/720] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:06 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:07.800061 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:07.800664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:07.807062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:07.807534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:07.807998 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:07.808673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:07.809119 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:07.809530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:07.949571 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:07.963436 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:07.966354 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:07.970074 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8a0ae151-fe40-45e8-ba94-b09b4d87420e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1723 microversion: 2.20 time: 0.173655 Oct 14 18:01:07.971110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 356/721] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:07 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:07.976817 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ad5f0146-80be-45c5-bb11-aa87005e4a33 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:07.977776 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ad5f0146-80be-45c5-bb11-aa87005e4a33 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:07.984525 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ad5f0146-80be-45c5-bb11-aa87005e4a33 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:07.985151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ad5f0146-80be-45c5-bb11-aa87005e4a33 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:07.985661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ad5f0146-80be-45c5-bb11-aa87005e4a33 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:07.986471 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ad5f0146-80be-45c5-bb11-aa87005e4a33 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:07.986984 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ad5f0146-80be-45c5-bb11-aa87005e4a33 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:07.987605 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ad5f0146-80be-45c5-bb11-aa87005e4a33 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:08.053500 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ad5f0146-80be-45c5-bb11-aa87005e4a33 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:08.065413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ad5f0146-80be-45c5-bb11-aa87005e4a33 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1185 microversion: 2.1 time: 0.092497 Oct 14 18:01:08.066002 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 366/722] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:07 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:08.535499 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fa9186e3-de7c-4d14-bd04-681c8fef827a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:08.538168 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fa9186e3-de7c-4d14-bd04-681c8fef827a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:08.548758 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa9186e3-de7c-4d14-bd04-681c8fef827a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:08.549304 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa9186e3-de7c-4d14-bd04-681c8fef827a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:08.549745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa9186e3-de7c-4d14-bd04-681c8fef827a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:08.550451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa9186e3-de7c-4d14-bd04-681c8fef827a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:08.550907 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa9186e3-de7c-4d14-bd04-681c8fef827a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:08.551377 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fa9186e3-de7c-4d14-bd04-681c8fef827a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:08.585656 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fa9186e3-de7c-4d14-bd04-681c8fef827a tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054119 Oct 14 18:01:08.586229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 357/723] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:01:08 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 18:01:08.740194 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9c56dad4-a9bc-4cf7-acce-3f3cb2ee7eb2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:08.742999 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9c56dad4-a9bc-4cf7-acce-3f3cb2ee7eb2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:08.749685 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c56dad4-a9bc-4cf7-acce-3f3cb2ee7eb2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:08.751164 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c56dad4-a9bc-4cf7-acce-3f3cb2ee7eb2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:08.751776 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c56dad4-a9bc-4cf7-acce-3f3cb2ee7eb2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:08.752742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c56dad4-a9bc-4cf7-acce-3f3cb2ee7eb2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:08.753398 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c56dad4-a9bc-4cf7-acce-3f3cb2ee7eb2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:08.754221 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c56dad4-a9bc-4cf7-acce-3f3cb2ee7eb2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:08.765725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-f0be5d20-02b0-469b-9fc0-a0b3636f291a req-2f235bd3-773e-4ae2-b1ba-4e8c52a3366d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc764f20-1f93-4e6d-ac1a-588f161d6ee5", "name": "network-vif-unplugged", "status": "completed", "tag": "8a708001-7ad4-4eed-9fae-7d4dbab749c6"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:08.776783 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-f0be5d20-02b0-469b-9fc0-a0b3636f291a req-2f235bd3-773e-4ae2-b1ba-4e8c52a3366d service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:08.777267 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-f0be5d20-02b0-469b-9fc0-a0b3636f291a req-2f235bd3-773e-4ae2-b1ba-4e8c52a3366d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:08.777695 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-f0be5d20-02b0-469b-9fc0-a0b3636f291a req-2f235bd3-773e-4ae2-b1ba-4e8c52a3366d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:08.791978 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9c56dad4-a9bc-4cf7-acce-3f3cb2ee7eb2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057027 Oct 14 18:01:08.792548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 367/724] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:01:08 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 18:01:08.792965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-f0be5d20-02b0-469b-9fc0-a0b3636f291a req-2f235bd3-773e-4ae2-b1ba-4e8c52a3366d service nova] Creating event network-vif-unplugged:8a708001-7ad4-4eed-9fae-7d4dbab749c6 for instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 on hv-cinder-74915 Oct 14 18:01:08.799103 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-f0be5d20-02b0-469b-9fc0-a0b3636f291a req-2f235bd3-773e-4ae2-b1ba-4e8c52a3366d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038209 Oct 14 18:01:08.799726 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 358/725] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:01:08.857201 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-25db571b-404a-4c04-b423-87b329ca6819 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:08.857639 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-25db571b-404a-4c04-b423-87b329ca6819 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:08.864192 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-25db571b-404a-4c04-b423-87b329ca6819 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:08.864677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-25db571b-404a-4c04-b423-87b329ca6819 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:08.865110 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-25db571b-404a-4c04-b423-87b329ca6819 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:08.865799 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-25db571b-404a-4c04-b423-87b329ca6819 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:08.866251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-25db571b-404a-4c04-b423-87b329ca6819 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:08.866671 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-25db571b-404a-4c04-b423-87b329ca6819 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:08.890673 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-25db571b-404a-4c04-b423-87b329ca6819 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:01:08.964695 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-25db571b-404a-4c04-b423-87b329ca6819 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 204 len: 0 microversion: 2.1 time: 0.111171 Oct 14 18:01:08.965289 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 368/726] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:01:08 2022] DELETE /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:01:08.975261 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-29a56002-48d5-4998-a95f-97a71667f663 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:08.976004 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-29a56002-48d5-4998-a95f-97a71667f663 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:08.982052 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a56002-48d5-4998-a95f-97a71667f663 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:08.982530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a56002-48d5-4998-a95f-97a71667f663 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:08.982984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a56002-48d5-4998-a95f-97a71667f663 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:08.983638 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a56002-48d5-4998-a95f-97a71667f663 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:08.984117 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a56002-48d5-4998-a95f-97a71667f663 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:08.984533 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a56002-48d5-4998-a95f-97a71667f663 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:08.997774 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:08.998857 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:09.006224 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:09.007055 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:09.007686 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:09.008598 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:09.009233 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:09.009878 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:09.234499 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-29a56002-48d5-4998-a95f-97a71667f663 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:09.238104 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:09.242821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-29a56002-48d5-4998-a95f-97a71667f663 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1674 microversion: 2.1 time: 0.272233 Oct 14 18:01:09.243668 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 359/727] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:08 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1674 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:09.246870 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:09.248145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c15c5d3c-0fbe-4a13-8c49-e23f0590e24f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:09.248746 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c15c5d3c-0fbe-4a13-8c49-e23f0590e24f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:09.248918 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:09.250124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8a411f36-7d16-41ba-b10c-46a7e8044566 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1726 microversion: 2.20 time: 0.257522 Oct 14 18:01:09.250984 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 369/728] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:08 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1726 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 18:01:09.255293 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c15c5d3c-0fbe-4a13-8c49-e23f0590e24f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:09.255808 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c15c5d3c-0fbe-4a13-8c49-e23f0590e24f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:09.256303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c15c5d3c-0fbe-4a13-8c49-e23f0590e24f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:09.257091 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c15c5d3c-0fbe-4a13-8c49-e23f0590e24f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:09.257599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c15c5d3c-0fbe-4a13-8c49-e23f0590e24f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:09.258044 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c15c5d3c-0fbe-4a13-8c49-e23f0590e24f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:09.276618 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3d1f367c-30f6-4d1b-a53b-cc085fa6b34a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f98a592-1208-4190-91d9-e428e1895b67"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:09.278996 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3d1f367c-30f6-4d1b-a53b-cc085fa6b34a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:09.286248 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3d1f367c-30f6-4d1b-a53b-cc085fa6b34a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:09.286887 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3d1f367c-30f6-4d1b-a53b-cc085fa6b34a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:09.287263 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3d1f367c-30f6-4d1b-a53b-cc085fa6b34a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:09.288072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3d1f367c-30f6-4d1b-a53b-cc085fa6b34a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:09.288540 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3d1f367c-30f6-4d1b-a53b-cc085fa6b34a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:09.288955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3d1f367c-30f6-4d1b-a53b-cc085fa6b34a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:09.326648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c15c5d3c-0fbe-4a13-8c49-e23f0590e24f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:09.335494 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c15c5d3c-0fbe-4a13-8c49-e23f0590e24f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1203 microversion: 2.1 time: 0.090862 Oct 14 18:01:09.336303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 360/729] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:09 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1203 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:09.474488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:09.561072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3d1f367c-30f6-4d1b-a53b-cc085fa6b34a tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "POST /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288519 Oct 14 18:01:09.561668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 370/730] 10.222.0.27 () {62 vars in 1364 bytes} [Fri Oct 14 18:01:09 2022] POST /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 18:01:09.688893 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-67ab20f1-e9b7-48fa-9c5f-ac8e872d26b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:09.689387 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-67ab20f1-e9b7-48fa-9c5f-ac8e872d26b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:09.695229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-67ab20f1-e9b7-48fa-9c5f-ac8e872d26b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:09.695699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-67ab20f1-e9b7-48fa-9c5f-ac8e872d26b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:09.696164 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-67ab20f1-e9b7-48fa-9c5f-ac8e872d26b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:09.696834 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-67ab20f1-e9b7-48fa-9c5f-ac8e872d26b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:09.697279 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-67ab20f1-e9b7-48fa-9c5f-ac8e872d26b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:09.697696 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-67ab20f1-e9b7-48fa-9c5f-ac8e872d26b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:09.922209 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:09.929752 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-67ab20f1-e9b7-48fa-9c5f-ac8e872d26b0 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/os-volume_attachments/9f98a592-1208-4190-91d9-e428e1895b67" status: 202 len: 0 microversion: 2.20 time: 0.244941 Oct 14 18:01:09.930340 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 361/731] 10.222.0.27 () {60 vars in 1457 bytes} [Fri Oct 14 18:01:09 2022] DELETE /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/os-volume_attachments/9f98a592-1208-4190-91d9-e428e1895b67 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:01:09.991011 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-295711f5-3046-4e44-bbcc-cd9c7f1fa327 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:09.991594 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-295711f5-3046-4e44-bbcc-cd9c7f1fa327 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:09.997358 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-295711f5-3046-4e44-bbcc-cd9c7f1fa327 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:09.997823 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-295711f5-3046-4e44-bbcc-cd9c7f1fa327 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:09.998364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-295711f5-3046-4e44-bbcc-cd9c7f1fa327 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:09.998905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-295711f5-3046-4e44-bbcc-cd9c7f1fa327 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:09.999342 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-295711f5-3046-4e44-bbcc-cd9c7f1fa327 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:09.999754 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-295711f5-3046-4e44-bbcc-cd9c7f1fa327 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:10.083918 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-295711f5-3046-4e44-bbcc-cd9c7f1fa327 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118655) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 18:01:10.150765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-295711f5-3046-4e44-bbcc-cd9c7f1fa327 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "POST /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/action" status: 202 len: 0 microversion: 2.20 time: 0.163445 Oct 14 18:01:10.151446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 371/732] 10.222.0.27 () {62 vars in 1319 bytes} [Fri Oct 14 18:01:09 2022] POST /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:01:10.160277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:10.160887 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:10.168577 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:10.169099 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:10.169544 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:10.170253 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:10.170686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:10.171105 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:10.267288 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f5c243f7-66d7-4e36-bced-9159687fcd6b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:10.268313 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f5c243f7-66d7-4e36-bced-9159687fcd6b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:10.275243 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5c243f7-66d7-4e36-bced-9159687fcd6b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:10.275728 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5c243f7-66d7-4e36-bced-9159687fcd6b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:10.276188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5c243f7-66d7-4e36-bced-9159687fcd6b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:10.277441 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5c243f7-66d7-4e36-bced-9159687fcd6b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:10.278043 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5c243f7-66d7-4e36-bced-9159687fcd6b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:10.278472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f5c243f7-66d7-4e36-bced-9159687fcd6b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:10.309911 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:10.320841 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:10.322395 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:10.323678 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9ef7c6e1-fe2b-4dab-88ab-5bb998cbce56 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1674 microversion: 2.20 time: 0.168052 Oct 14 18:01:10.324376 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 362/733] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:10 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:10.361781 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-79af7f5a-fa7a-4fae-9305-f9b3019569d1 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:10.362551 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-79af7f5a-fa7a-4fae-9305-f9b3019569d1 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:10.364651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:10.370148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79af7f5a-fa7a-4fae-9305-f9b3019569d1 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:10.370751 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79af7f5a-fa7a-4fae-9305-f9b3019569d1 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:10.371305 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79af7f5a-fa7a-4fae-9305-f9b3019569d1 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:10.372109 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79af7f5a-fa7a-4fae-9305-f9b3019569d1 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:10.372634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79af7f5a-fa7a-4fae-9305-f9b3019569d1 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:10.373124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-79af7f5a-fa7a-4fae-9305-f9b3019569d1 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:10.438625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f5c243f7-66d7-4e36-bced-9159687fcd6b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:10.447501 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f5c243f7-66d7-4e36-bced-9159687fcd6b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1674 microversion: 2.1 time: 0.184746 Oct 14 18:01:10.448099 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 372/734] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:10 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:01:10.460126 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-79af7f5a-fa7a-4fae-9305-f9b3019569d1 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:10.466658 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-79af7f5a-fa7a-4fae-9305-f9b3019569d1 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1203 microversion: 2.1 time: 0.110130 Oct 14 18:01:10.467231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 363/735] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:10 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1203 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:11.355590 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:11.356770 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:11.364553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:11.365254 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:11.365842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:11.367140 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:11.367865 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:11.368790 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:11.473706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-50f460d1-ae4c-4fae-a4d3-7ad985cac783 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:11.474391 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-50f460d1-ae4c-4fae-a4d3-7ad985cac783 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:11.483677 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50f460d1-ae4c-4fae-a4d3-7ad985cac783 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:11.485954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50f460d1-ae4c-4fae-a4d3-7ad985cac783 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:11.488534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50f460d1-ae4c-4fae-a4d3-7ad985cac783 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:11.489524 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50f460d1-ae4c-4fae-a4d3-7ad985cac783 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:11.490547 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50f460d1-ae4c-4fae-a4d3-7ad985cac783 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:11.491612 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50f460d1-ae4c-4fae-a4d3-7ad985cac783 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:11.654015 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:11.665162 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:11.667136 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:11.669858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e35ca79d-0623-4d27-bb97-b9292f1ddca7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1676 microversion: 2.20 time: 0.318039 Oct 14 18:01:11.670915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 373/736] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:11 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1676 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:11.687591 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-124fb2e2-d013-4bf1-9a99-b15ddf13b675 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:11.687591 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-124fb2e2-d013-4bf1-9a99-b15ddf13b675 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:11.697348 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-124fb2e2-d013-4bf1-9a99-b15ddf13b675 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:11.697902 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-124fb2e2-d013-4bf1-9a99-b15ddf13b675 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:11.698418 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-124fb2e2-d013-4bf1-9a99-b15ddf13b675 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:11.699214 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-124fb2e2-d013-4bf1-9a99-b15ddf13b675 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:11.699672 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-124fb2e2-d013-4bf1-9a99-b15ddf13b675 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:11.700291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-124fb2e2-d013-4bf1-9a99-b15ddf13b675 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:11.726795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-50f460d1-ae4c-4fae-a4d3-7ad985cac783 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:11.742413 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-50f460d1-ae4c-4fae-a4d3-7ad985cac783 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1674 microversion: 2.1 time: 0.269422 Oct 14 18:01:11.743046 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 364/737] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:11 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1674 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:12.016976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-124fb2e2-d013-4bf1-9a99-b15ddf13b675 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:12.028323 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-124fb2e2-d013-4bf1-9a99-b15ddf13b675 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.356191 Oct 14 18:01:12.029107 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 374/738] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:11 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:12.184966 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-79d92e01-5357-4134-b9b3-095711351504 req-3f81439f-6eb5-48cb-a7e2-499d3ed6f39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "557fb52b-468d-475a-a26d-71d7975ef533", "name": "network-vif-deleted", "tag": "6f1cafbd-d8fe-433d-83bd-3cccddfa6e16"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:12.194732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-79d92e01-5357-4134-b9b3-095711351504 req-3f81439f-6eb5-48cb-a7e2-499d3ed6f39c service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:12.195224 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-79d92e01-5357-4134-b9b3-095711351504 req-3f81439f-6eb5-48cb-a7e2-499d3ed6f39c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:12.195898 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-79d92e01-5357-4134-b9b3-095711351504 req-3f81439f-6eb5-48cb-a7e2-499d3ed6f39c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:12.461458 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-79d92e01-5357-4134-b9b3-095711351504 req-3f81439f-6eb5-48cb-a7e2-499d3ed6f39c service nova] Creating event network-vif-deleted:6f1cafbd-d8fe-433d-83bd-3cccddfa6e16 for instance 557fb52b-468d-475a-a26d-71d7975ef533 on hv-cinder-74915 Oct 14 18:01:12.481870 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-79d92e01-5357-4134-b9b3-095711351504 req-3f81439f-6eb5-48cb-a7e2-499d3ed6f39c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297503 Oct 14 18:01:12.482534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 365/739] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:12.707237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:12.708653 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:12.738259 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:12.738954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:12.740020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:12.740996 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:12.741934 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:12.742647 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:12.786858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-732e71c1-a14a-4c65-ae20-cbb47b0a8802 req-841e0000-5afe-4fad-a7b8-3e5f3e3fcd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28431df1-6972-4ad5-b90c-c1dcb54d5a98", "tag": "f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:12.801046 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-732e71c1-a14a-4c65-ae20-cbb47b0a8802 req-841e0000-5afe-4fad-a7b8-3e5f3e3fcd6c service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:12.801862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-732e71c1-a14a-4c65-ae20-cbb47b0a8802 req-841e0000-5afe-4fad-a7b8-3e5f3e3fcd6c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:12.802448 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-732e71c1-a14a-4c65-ae20-cbb47b0a8802 req-841e0000-5afe-4fad-a7b8-3e5f3e3fcd6c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:12.818888 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-732e71c1-a14a-4c65-ae20-cbb47b0a8802 req-841e0000-5afe-4fad-a7b8-3e5f3e3fcd6c service nova] Creating event network-changed:f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf for instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 on hv-cinder-74915 Oct 14 18:01:12.825451 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-732e71c1-a14a-4c65-ae20-cbb47b0a8802 req-841e0000-5afe-4fad-a7b8-3e5f3e3fcd6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141758 Oct 14 18:01:12.827496 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 375/740] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:12.837180 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:12.839391 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:12.850441 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:12.852569 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:12.852569 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:12.853576 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:12.854431 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:12.855633 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:12.893744 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:12.894530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:12.894962 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:12.895405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lazy-loading 'fault' on Instance uuid 557fb52b-468d-475a-a26d-71d7975ef533 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:01:12.962317 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '762e1e38e4234803991187db9b870b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5488304972c48fab9a2b9711cf7e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:12.970928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4f950505-e57f-476a-b087-3b5bbfc2682b tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 200 len: 1326 microversion: 2.1 time: 0.140458 Oct 14 18:01:12.971514 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 376/741] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:12 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 1326 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:12.978429 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:12.988551 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:12.990047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:12.991187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-16582952-edac-4af3-ac43-e8979aed3cf9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.293222 Oct 14 18:01:12.991732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 366/742] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:12 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:13.053393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ce4b5e18-f394-45b8-9d0a-d4dd22d0d2ca tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:13.054032 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ce4b5e18-f394-45b8-9d0a-d4dd22d0d2ca tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:13.059928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce4b5e18-f394-45b8-9d0a-d4dd22d0d2ca tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:13.060422 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce4b5e18-f394-45b8-9d0a-d4dd22d0d2ca tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:13.060855 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce4b5e18-f394-45b8-9d0a-d4dd22d0d2ca tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:13.061548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce4b5e18-f394-45b8-9d0a-d4dd22d0d2ca tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:13.061997 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce4b5e18-f394-45b8-9d0a-d4dd22d0d2ca tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:13.062417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce4b5e18-f394-45b8-9d0a-d4dd22d0d2ca tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:13.294612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ce4b5e18-f394-45b8-9d0a-d4dd22d0d2ca tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:13.303599 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ce4b5e18-f394-45b8-9d0a-d4dd22d0d2ca tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.253840 Oct 14 18:01:13.309131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 377/743] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:13 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:13.994907 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:13.996086 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:14.003086 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:14.003914 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:14.004529 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:14.005418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:14.006039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:14.006640 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:14.016928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:14.017830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:14.023125 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] HTTP exception thrown: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Request method failure captured: Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 HTTP/1.1 Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaJ9BYmB5FmVpW5Kvr0Vwh6NsKmeg9VvR2SjjSv0xFUCI60wq3fIv6OcVGa2KFnFqLC485rP3iM6Ynky5vLJa1b0J_4VbvarwwKjQvXiNPwHQ3VfqWZjMNdhqZ-p7fPGlxp_pE9qJmX3zTB56EMYZCOLE3YLGMoOQ6oPQbTw2YyySaQ Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:14.025255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5488304972c48fab9a2b9711cf7e9c8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeTestJSON-994361560-project Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 762e1e38e4234803991187db9b870b9c Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeTestJSON-994361560-project Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:14.026973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': '557fb52b-468d-475a-a26d-71d7975ef533'} Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:14.027821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:14.029140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:14.031449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Returning 404 to user: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:14.032328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:14.032930 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:14.033488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:14.033748 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-02bd6d07-1ff6-4dbb-8f98-bb922527e91e tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 404 len: 111 microversion: 2.1 time: 0.042826 Oct 14 18:01:14.034802 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:14.034921 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 367/744] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:13 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:01:14.038651 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:14.039643 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:14.053020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e6d76aff-67b1-449c-af89-f901788517e2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '.version_select at 0x7fe3da4cda60>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:14.089006 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e6d76aff-67b1-449c-af89-f901788517e2 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-147499857" status: 202 len: 0 microversion: 2.1 time: 0.039658 Oct 14 18:01:14.089525 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 368/745] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Oct 14 18:01:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-147499857 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:01:14.239190 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:14.248631 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:14.253442 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:14.256144 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c360c761-2fc5-4573-8e1c-e1d3964543b4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.243393 Oct 14 18:01:14.257455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 378/746] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:14 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:14.336846 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e8dd7cef-48b6-4189-9f88-c26241edfc44 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:14.337578 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e8dd7cef-48b6-4189-9f88-c26241edfc44 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:14.367348 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e8dd7cef-48b6-4189-9f88-c26241edfc44 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:14.367848 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e8dd7cef-48b6-4189-9f88-c26241edfc44 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:14.368444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e8dd7cef-48b6-4189-9f88-c26241edfc44 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:14.369168 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e8dd7cef-48b6-4189-9f88-c26241edfc44 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:14.369622 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e8dd7cef-48b6-4189-9f88-c26241edfc44 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:14.370047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e8dd7cef-48b6-4189-9f88-c26241edfc44 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:14.655808 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e8dd7cef-48b6-4189-9f88-c26241edfc44 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:14.674903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e8dd7cef-48b6-4189-9f88-c26241edfc44 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.343806 Oct 14 18:01:14.699572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 369/747] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:14 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:15.283344 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:15.283956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:15.291273 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:15.291753 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:15.292213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:15.292910 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:15.293351 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:15.293946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:15.447518 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:15.456590 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:15.458225 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:15.459491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-1e5843e5-cd21-46a4-9869-412f3fa2d349 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.180812 Oct 14 18:01:15.460246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 379/748] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:15 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:15.706071 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1b81a759-e6c2-49c9-8f57-f39c11a0b932 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:15.706707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1b81a759-e6c2-49c9-8f57-f39c11a0b932 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:15.709065 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:15.709738 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=6 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:15.715043 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b81a759-e6c2-49c9-8f57-f39c11a0b932 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:15.715655 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b81a759-e6c2-49c9-8f57-f39c11a0b932 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:15.716127 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b81a759-e6c2-49c9-8f57-f39c11a0b932 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:15.716825 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b81a759-e6c2-49c9-8f57-f39c11a0b932 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:15.717276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b81a759-e6c2-49c9-8f57-f39c11a0b932 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:15.717694 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1b81a759-e6c2-49c9-8f57-f39c11a0b932 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:15.862516 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1b81a759-e6c2-49c9-8f57-f39c11a0b932 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:15.870406 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1b81a759-e6c2-49c9-8f57-f39c11a0b932 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.168384 Oct 14 18:01:15.870978 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 370/749] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:15 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:16.492357 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:16.493039 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:16.495082 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:16.501816 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:16.502328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:16.502753 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:16.503481 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:16.503982 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:16.504399 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:16.649226 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:16.658868 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:16.660325 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:16.661720 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e6893c41-917d-49f3-a9aa-f368beac9ebc tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.173927 Oct 14 18:01:16.662582 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 380/750] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:16 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:16.894565 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-60c8db9d-24df-4283-98e2-dd2a75d648de tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:16.895319 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-60c8db9d-24df-4283-98e2-dd2a75d648de tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:16.902330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-60c8db9d-24df-4283-98e2-dd2a75d648de tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:16.902746 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-60c8db9d-24df-4283-98e2-dd2a75d648de tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:16.903177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-60c8db9d-24df-4283-98e2-dd2a75d648de tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:16.903981 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-60c8db9d-24df-4283-98e2-dd2a75d648de tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:16.904431 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-60c8db9d-24df-4283-98e2-dd2a75d648de tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:16.904854 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-60c8db9d-24df-4283-98e2-dd2a75d648de tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:17.052766 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-60c8db9d-24df-4283-98e2-dd2a75d648de tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:17.061014 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-60c8db9d-24df-4283-98e2-dd2a75d648de tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.170772 Oct 14 18:01:17.076323 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 371/751] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:16 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:17.490219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:17.491033 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:17.497853 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:17.498506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:17.498892 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:17.499651 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:17.500197 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:17.501882 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:17.515714 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] HTTP exception thrown: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Request method failure captured: Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: DELETE /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 HTTP/1.1 Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaJ9BYmB5FmVpW5Kvr0Vwh6NsKmeg9VvR2SjjSv0xFUCI60wq3fIv6OcVGa2KFnFqLC485rP3iM6Ynky5vLJa1b0J_4VbvarwwKjQvXiNPwHQ3VfqWZjMNdhqZ-p7fPGlxp_pE9qJmX3zTB56EMYZCOLE3YLGMoOQ6oPQbTw2YyySaQ Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:01:17.518075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5488304972c48fab9a2b9711cf7e9c8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeTestJSON-994361560-project Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 762e1e38e4234803991187db9b870b9c Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeTestJSON-994361560-project Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:17.519731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '557fb52b-468d-475a-a26d-71d7975ef533'} Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:17.520654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:17.522085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:17.524199 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Returning 404 to user: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:17.525218 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d7dd2f35-b523-41db-860b-62947a2759d3 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 404 len: 111 microversion: 2.1 time: 0.038832 Oct 14 18:01:17.525778 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 381/752] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:01:17 2022] DELETE /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:01:17.534897 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:17.535589 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: 557fb52b-468d-475a-a26d-71d7975ef533] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:17.542072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:17.542863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:17.543504 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:17.544338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:17.544989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:17.545470 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:17.560956 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] HTTP exception thrown: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Request method failure captured: Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 HTTP/1.1 Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaJ9BYmB5FmVpW5Kvr0Vwh6NsKmeg9VvR2SjjSv0xFUCI60wq3fIv6OcVGa2KFnFqLC485rP3iM6Ynky5vLJa1b0J_4VbvarwwKjQvXiNPwHQ3VfqWZjMNdhqZ-p7fPGlxp_pE9qJmX3zTB56EMYZCOLE3YLGMoOQ6oPQbTw2YyySaQ Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:17.564177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5488304972c48fab9a2b9711cf7e9c8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeTestJSON-994361560-project Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 762e1e38e4234803991187db9b870b9c Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeTestJSON-994361560-project Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:17.565816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': '557fb52b-468d-475a-a26d-71d7975ef533'} Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:17.566863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. Oct 14 18:01:17.568102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:17.569414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Returning 404 to user: Instance 557fb52b-468d-475a-a26d-71d7975ef533 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:17.569414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d44d76ab-9b9d-42d7-b451-79de1b660149 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533" status: 404 len: 111 microversion: 2.1 time: 0.036187 Oct 14 18:01:17.569414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 372/753] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:17 2022] GET /compute/v2.1/servers/557fb52b-468d-475a-a26d-71d7975ef533 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:01:17.689000 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:17.690148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:17.696639 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:17.697242 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:17.697913 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:17.698857 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:17.699568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:17.700400 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:17.853185 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:17.862134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:17.863572 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:17.865023 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3c702e44-fc64-4b07-b9aa-fd563da492b5 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.180258 Oct 14 18:01:17.865571 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 382/754] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:17 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:18.085066 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e9d50c92-68ab-4981-a8ae-0170bb1dda81 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:18.085734 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e9d50c92-68ab-4981-a8ae-0170bb1dda81 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:18.092374 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e9d50c92-68ab-4981-a8ae-0170bb1dda81 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:18.092863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e9d50c92-68ab-4981-a8ae-0170bb1dda81 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:18.093302 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e9d50c92-68ab-4981-a8ae-0170bb1dda81 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:18.093999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e9d50c92-68ab-4981-a8ae-0170bb1dda81 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:18.094457 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e9d50c92-68ab-4981-a8ae-0170bb1dda81 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:18.094875 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e9d50c92-68ab-4981-a8ae-0170bb1dda81 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:18.241428 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e9d50c92-68ab-4981-a8ae-0170bb1dda81 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:18.249395 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e9d50c92-68ab-4981-a8ae-0170bb1dda81 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.168095 Oct 14 18:01:18.250195 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 373/755] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:18 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:18.723217 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:18.724380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:18.731761 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:18.732406 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:18.733056 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:18.733934 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:18.734396 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:18.735297 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:18.749043 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] HTTP exception thrown: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Request method failure captured: Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: DELETE /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 HTTP/1.1 Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaJ9BYmB5FmVpW5Kvr0Vwh6NsKmeg9VvR2SjjSv0xFUCI60wq3fIv6OcVGa2KFnFqLC485rP3iM6Ynky5vLJa1b0J_4VbvarwwKjQvXiNPwHQ3VfqWZjMNdhqZ-p7fPGlxp_pE9qJmX3zTB56EMYZCOLE3YLGMoOQ6oPQbTw2YyySaQ Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:01:18.751178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5488304972c48fab9a2b9711cf7e9c8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeTestJSON-994361560-project Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 762e1e38e4234803991187db9b870b9c Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeTestJSON-994361560-project Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 18:01:18.752895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'c8dd3e30-1c69-471e-8b17-4205d267eb94'} Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:18.757096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 18:01:18.758530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:18.759949 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Returning 404 to user: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:18.759949 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b90a8776-5006-4a36-b183-221dd82d8f28 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 404 len: 111 microversion: 2.1 time: 0.033552 Oct 14 18:01:18.759949 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 383/756] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:01:18 2022] DELETE /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:01:18.765242 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:18.765865 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] [instance: c8dd3e30-1c69-471e-8b17-4205d267eb94] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:18.772157 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:18.772645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:18.773079 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:18.773778 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:18.774230 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:18.774653 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:18.788454 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] HTTP exception thrown: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Request method failure captured: Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 HTTP/1.1 Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaJ9BYmB5FmVpW5Kvr0Vwh6NsKmeg9VvR2SjjSv0xFUCI60wq3fIv6OcVGa2KFnFqLC485rP3iM6Ynky5vLJa1b0J_4VbvarwwKjQvXiNPwHQ3VfqWZjMNdhqZ-p7fPGlxp_pE9qJmX3zTB56EMYZCOLE3YLGMoOQ6oPQbTw2YyySaQ Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:18.789999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5488304972c48fab9a2b9711cf7e9c8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5488304972c48fab9a2b9711cf7e9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: f5488304972c48fab9a2b9711cf7e9c8 Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeTestJSON-994361560 Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeTestJSON-994361560-project Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 762e1e38e4234803991187db9b870b9c Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeTestJSON-994361560-project Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 18:01:18.791583 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'c8dd3e30-1c69-471e-8b17-4205d267eb94'} Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:18.792466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. Oct 14 18:01:18.793715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:18.794765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] Returning 404 to user: Instance c8dd3e30-1c69-471e-8b17-4205d267eb94 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:18.794765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a04f56b9-c0e0-4190-a659-a163a1806754 tempest-AttachVolumeTestJSON-994361560 tempest-AttachVolumeTestJSON-994361560-project] 10.222.0.27 "GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94" status: 404 len: 111 microversion: 2.1 time: 0.030015 Oct 14 18:01:18.794765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 374/757] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:18 2022] GET /compute/v2.1/servers/c8dd3e30-1c69-471e-8b17-4205d267eb94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:01:18.894081 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:18.895360 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:18.902076 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:18.902890 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:18.903551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:18.904524 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:18.905326 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:18.905960 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:19.045708 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:19.066072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:19.067816 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:19.070013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-81f595fd-4677-44d0-852c-b0f890fd3d08 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.180381 Oct 14 18:01:19.073271 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 384/758] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:18 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:19.273241 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-227e10a1-8b59-40ba-ba24-f1c9d2324d11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:19.274701 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-227e10a1-8b59-40ba-ba24-f1c9d2324d11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:19.281472 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-227e10a1-8b59-40ba-ba24-f1c9d2324d11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:19.282676 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-227e10a1-8b59-40ba-ba24-f1c9d2324d11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:19.283325 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-227e10a1-8b59-40ba-ba24-f1c9d2324d11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:19.284057 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-227e10a1-8b59-40ba-ba24-f1c9d2324d11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:19.284665 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-227e10a1-8b59-40ba-ba24-f1c9d2324d11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:19.285241 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-227e10a1-8b59-40ba-ba24-f1c9d2324d11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:19.441802 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-227e10a1-8b59-40ba-ba24-f1c9d2324d11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:19.451175 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-227e10a1-8b59-40ba-ba24-f1c9d2324d11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.182209 Oct 14 18:01:19.452154 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 375/759] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:19 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:20.101584 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:20.104188 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:20.115017 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:20.115808 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:20.116487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:20.117427 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:20.118633 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:20.119267 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:20.380963 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:20.401367 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:20.402790 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:20.404498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-04612ed2-d863-4967-98e2-a3d6283156c4 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.306369 Oct 14 18:01:20.420973 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 385/760] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:20 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:20.486315 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-623179a5-a439-4362-b4c0-7b6b7b138870 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:20.487108 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-623179a5-a439-4362-b4c0-7b6b7b138870 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:20.503015 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-623179a5-a439-4362-b4c0-7b6b7b138870 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:20.503798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-623179a5-a439-4362-b4c0-7b6b7b138870 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:20.504637 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-623179a5-a439-4362-b4c0-7b6b7b138870 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:20.505526 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-623179a5-a439-4362-b4c0-7b6b7b138870 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:20.506272 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-623179a5-a439-4362-b4c0-7b6b7b138870 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:20.506855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-623179a5-a439-4362-b4c0-7b6b7b138870 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:20.707083 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-623179a5-a439-4362-b4c0-7b6b7b138870 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:20.721618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-623179a5-a439-4362-b4c0-7b6b7b138870 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.249937 Oct 14 18:01:20.722200 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 376/761] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:20 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:21.434401 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:21.435036 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:21.447594 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:21.448928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:21.449368 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:21.451239 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:21.452513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:21.452953 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:21.496454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:21.744957 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:21.746163 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7400abe8-18ee-4092-a173-8eab75728dd8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:21.746776 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7400abe8-18ee-4092-a173-8eab75728dd8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:21.753398 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7400abe8-18ee-4092-a173-8eab75728dd8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:21.753890 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7400abe8-18ee-4092-a173-8eab75728dd8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:21.754324 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7400abe8-18ee-4092-a173-8eab75728dd8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:21.754466 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:21.755032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7400abe8-18ee-4092-a173-8eab75728dd8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:21.755487 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7400abe8-18ee-4092-a173-8eab75728dd8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:21.755795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:21.755936 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7400abe8-18ee-4092-a173-8eab75728dd8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:21.756986 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a3c4efca-de42-4033-8879-aa076937bfe6 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.326859 Oct 14 18:01:21.757534 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 386/762] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:21 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:21.942190 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7400abe8-18ee-4092-a173-8eab75728dd8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:21.964404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7400abe8-18ee-4092-a173-8eab75728dd8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.221898 Oct 14 18:01:21.980959 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 377/763] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:21 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:01:22.788156 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:22.789600 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:22.803716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:22.803716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:22.803716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:22.803716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:22.805881 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:22.805881 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:22.961328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:22.972660 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:22.974382 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:22.975611 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-60cd5cbb-68d0-413b-bcb3-e75866cb49d7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.193801 Oct 14 18:01:22.976189 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 387/764] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:22 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:23.000457 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0a88f42a-e612-41a6-be6f-c84b1b4d0ea9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:23.002217 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0a88f42a-e612-41a6-be6f-c84b1b4d0ea9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:23.009073 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a88f42a-e612-41a6-be6f-c84b1b4d0ea9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:23.009781 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a88f42a-e612-41a6-be6f-c84b1b4d0ea9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:23.010381 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a88f42a-e612-41a6-be6f-c84b1b4d0ea9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:23.011243 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a88f42a-e612-41a6-be6f-c84b1b4d0ea9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:23.011855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a88f42a-e612-41a6-be6f-c84b1b4d0ea9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:23.013187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a88f42a-e612-41a6-be6f-c84b1b4d0ea9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:23.168195 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0a88f42a-e612-41a6-be6f-c84b1b4d0ea9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:23.176646 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0a88f42a-e612-41a6-be6f-c84b1b4d0ea9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.179981 Oct 14 18:01:23.177349 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 378/765] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:22 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:24.002895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:24.004169 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:24.012452 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:24.012935 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:24.013364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:24.014061 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:24.014508 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:24.014926 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:24.147344 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:24.156019 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:24.157513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:24.158664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9cd395b0-e9c9-408a-a33b-b30427e38b5e tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.160328 Oct 14 18:01:24.159220 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 388/766] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:23 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:24.200099 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4e8df271-eb6e-415f-91e9-3a410a4cc165 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:24.200709 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4e8df271-eb6e-415f-91e9-3a410a4cc165 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:24.206552 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e8df271-eb6e-415f-91e9-3a410a4cc165 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:24.207028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e8df271-eb6e-415f-91e9-3a410a4cc165 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:24.207487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e8df271-eb6e-415f-91e9-3a410a4cc165 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:24.208229 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e8df271-eb6e-415f-91e9-3a410a4cc165 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:24.208707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e8df271-eb6e-415f-91e9-3a410a4cc165 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:24.209123 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e8df271-eb6e-415f-91e9-3a410a4cc165 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:24.247440 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-33a65ce3-2664-4a94-9569-b198c578fa83 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Action: 'create', calling method: .version_select at 0x7fe3da539af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1128705923"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:24.341734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4e8df271-eb6e-415f-91e9-3a410a4cc165 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:24.350150 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4e8df271-eb6e-415f-91e9-3a410a4cc165 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.153891 Oct 14 18:01:24.350809 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 389/767] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:24 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:01:24.536075 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-33a65ce3-2664-4a94-9569-b198c578fa83 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.403997 Oct 14 18:01:24.536959 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 379/768] 10.222.0.27 () {60 vars in 1155 bytes} [Fri Oct 14 18:01:24 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 14 18:01:24.550148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7ced09a2-0a26-4c3b-94d0-9ce2668d0f03 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da59ed30>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:24.601787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7ced09a2-0a26-4c3b-94d0-9ce2668d0f03 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00" status: 200 len: 345 microversion: 2.1 time: 0.055976 Oct 14 18:01:24.602386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 390/769] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 18:01:24 2022] GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:25.184970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:25.185580 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:25.193009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:25.193501 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:25.193946 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:25.194679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:25.195140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:25.195590 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:25.325058 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:25.333988 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:25.335435 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:25.336630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-29a76e2f-9d23-42d1-b826-fdb4664ac5d9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.156055 Oct 14 18:01:25.337180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 380/770] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:25 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:25.373853 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6590f666-dc35-40d2-b034-03cb57d9fbf9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:25.374456 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6590f666-dc35-40d2-b034-03cb57d9fbf9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:25.381238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6590f666-dc35-40d2-b034-03cb57d9fbf9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:25.381709 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6590f666-dc35-40d2-b034-03cb57d9fbf9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:25.382134 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6590f666-dc35-40d2-b034-03cb57d9fbf9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:25.382806 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6590f666-dc35-40d2-b034-03cb57d9fbf9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:25.383248 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6590f666-dc35-40d2-b034-03cb57d9fbf9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:25.383667 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6590f666-dc35-40d2-b034-03cb57d9fbf9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:25.513418 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6590f666-dc35-40d2-b034-03cb57d9fbf9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:25.521380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6590f666-dc35-40d2-b034-03cb57d9fbf9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.151862 Oct 14 18:01:25.521938 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 391/771] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:25 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:25.615946 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f6155f59-c249-4cee-ad7f-a862594a7fb8 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da539b80>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:25.662299 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f6155f59-c249-4cee-ad7f-a862594a7fb8 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00" status: 200 len: 346 microversion: 2.1 time: 0.050103 Oct 14 18:01:25.662954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 381/772] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 18:01:25 2022] GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:25.676411 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-84b0c906-49ae-49a5-9741-77f12d251f82 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Action: 'create', calling method: .version_select at 0x7fe3da5ecc10>, body: {"snapshot": {"volume_id": "d4951816-b17a-4d5f-882c-57fcea7f1c00", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1936848166"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:25.825631 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-84b0c906-49ae-49a5-9741-77f12d251f82 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.153382 Oct 14 18:01:25.826221 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 392/773] 10.222.0.27 () {60 vars in 1162 bytes} [Fri Oct 14 18:01:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:25.838592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-075282c5-ed9d-463f-99f7-c5cb47cd789a tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da539ca0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:25.868109 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-075282c5-ed9d-463f-99f7-c5cb47cd789a tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae" status: 200 len: 287 microversion: 2.1 time: 0.033955 Oct 14 18:01:25.868622 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 382/774] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Oct 14 18:01:25 2022] GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:25.880135 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a9ce19d5-a96e-45e5-8c55-d362a1fd06c9 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da80da60>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:25.910068 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a9ce19d5-a96e-45e5-8c55-d362a1fd06c9 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034106 Oct 14 18:01:25.910625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 393/775] 10.222.0.27 () {58 vars in 1140 bytes} [Fri Oct 14 18:01:25 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:01:25.921799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-57bbb8ad-4e88-423c-b53e-2a4c263b87b7 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da429d30>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:25.953604 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-57bbb8ad-4e88-423c-b53e-2a4c263b87b7 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae" status: 200 len: 287 microversion: 2.1 time: 0.035469 Oct 14 18:01:25.955337 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 383/776] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Oct 14 18:01:25 2022] GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:26.363020 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:26.363627 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:26.370193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:26.370670 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:26.371102 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:26.371788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:26.372274 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:26.372694 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:26.505638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:26.513562 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:26.514925 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:26.516097 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9c46b27d-2bc8-4d87-bf50-d52fcdea5495 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.157483 Oct 14 18:01:26.516938 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 394/777] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:26 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:26.544440 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fca46881-c598-4c20-8674-c4029447b44f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:26.545048 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fca46881-c598-4c20-8674-c4029447b44f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:26.551765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fca46881-c598-4c20-8674-c4029447b44f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:26.552290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fca46881-c598-4c20-8674-c4029447b44f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:26.552727 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fca46881-c598-4c20-8674-c4029447b44f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:26.553427 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fca46881-c598-4c20-8674-c4029447b44f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:26.553882 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fca46881-c598-4c20-8674-c4029447b44f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:26.554302 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fca46881-c598-4c20-8674-c4029447b44f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:26.680979 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fca46881-c598-4c20-8674-c4029447b44f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:26.688529 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fca46881-c598-4c20-8674-c4029447b44f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.148473 Oct 14 18:01:26.689089 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 384/778] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:26 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:26.967404 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d08f6d5e-b295-40be-bdd6-448dddfe2043 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da5d8dc0>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:26.997139 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d08f6d5e-b295-40be-bdd6-448dddfe2043 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae" status: 200 len: 287 microversion: 2.1 time: 0.033367 Oct 14 18:01:26.997685 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 395/779] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Oct 14 18:01:26 2022] GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:27.542223 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:27.542833 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:27.550122 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:27.550695 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:27.551018 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:27.551705 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:27.552182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:27.552604 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:27.683237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:27.691669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:27.693135 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:27.694286 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-48ef07ab-0dac-4e51-aa87-a520f58f8b46 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.155975 Oct 14 18:01:27.694831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 385/780] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:27 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:27.711819 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c9a7c1f7-a323-4ce0-8f1d-69f8fa04bd93 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:27.712471 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c9a7c1f7-a323-4ce0-8f1d-69f8fa04bd93 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:27.718562 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1f7-a323-4ce0-8f1d-69f8fa04bd93 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:27.719036 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1f7-a323-4ce0-8f1d-69f8fa04bd93 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:27.719488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1f7-a323-4ce0-8f1d-69f8fa04bd93 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:27.720200 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1f7-a323-4ce0-8f1d-69f8fa04bd93 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:27.721457 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1f7-a323-4ce0-8f1d-69f8fa04bd93 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:27.721867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1f7-a323-4ce0-8f1d-69f8fa04bd93 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:27.850769 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c9a7c1f7-a323-4ce0-8f1d-69f8fa04bd93 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:27.858293 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c9a7c1f7-a323-4ce0-8f1d-69f8fa04bd93 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.150855 Oct 14 18:01:27.858841 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 396/781] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:27 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:28.009768 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fe3dd597-d428-464a-a027-6bbad2ba3e87 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da4cdc10>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:28.039849 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fe3dd597-d428-464a-a027-6bbad2ba3e87 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae" status: 200 len: 287 microversion: 2.1 time: 0.033811 Oct 14 18:01:28.040505 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 386/782] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Oct 14 18:01:28 2022] GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:28.721655 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:28.722256 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:28.728779 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:28.729385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:28.729870 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:28.730551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:28.730993 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:28.731407 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:28.857398 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:28.866649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:28.868099 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:28.869245 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d024dd9a-27db-47e9-ba6e-bddc35a1fdf1 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.152282 Oct 14 18:01:28.869793 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 397/783] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:28 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:28.881053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f1b19a00-a121-4753-b9ba-09c060951eba tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:28.881657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f1b19a00-a121-4753-b9ba-09c060951eba tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:28.888499 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f1b19a00-a121-4753-b9ba-09c060951eba tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:28.888984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f1b19a00-a121-4753-b9ba-09c060951eba tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:28.889417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f1b19a00-a121-4753-b9ba-09c060951eba tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:28.890357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f1b19a00-a121-4753-b9ba-09c060951eba tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:28.890813 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f1b19a00-a121-4753-b9ba-09c060951eba tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:28.891436 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f1b19a00-a121-4753-b9ba-09c060951eba tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:28.896288 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=99 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:29.001790 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-efd2127c-6ef1-4ab0-8159-ad629373e132 req-542457b2-77ca-47fd-95f0-b91dbfc8547d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28431df1-6972-4ad5-b90c-c1dcb54d5a98", "name": "network-vif-plugged", "status": "completed", "tag": "f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:29.011898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-efd2127c-6ef1-4ab0-8159-ad629373e132 req-542457b2-77ca-47fd-95f0-b91dbfc8547d service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:29.012524 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-efd2127c-6ef1-4ab0-8159-ad629373e132 req-542457b2-77ca-47fd-95f0-b91dbfc8547d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:29.013035 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-efd2127c-6ef1-4ab0-8159-ad629373e132 req-542457b2-77ca-47fd-95f0-b91dbfc8547d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:29.025144 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-efd2127c-6ef1-4ab0-8159-ad629373e132 req-542457b2-77ca-47fd-95f0-b91dbfc8547d service nova] Creating event network-vif-plugged:f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf for instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 on hv-cinder-74915 Oct 14 18:01:29.029419 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f1b19a00-a121-4753-b9ba-09c060951eba tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:29.030251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-efd2127c-6ef1-4ab0-8159-ad629373e132 req-542457b2-77ca-47fd-95f0-b91dbfc8547d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032337 Oct 14 18:01:29.030998 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 398/784] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:29.039304 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f1b19a00-a121-4753-b9ba-09c060951eba tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.162398 Oct 14 18:01:29.054893 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 387/785] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:28 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:29.057092 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-cd8b8f5a-ce50-4aba-8023-b8833f4e585e tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da5c1f70>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:29.090848 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-cd8b8f5a-ce50-4aba-8023-b8833f4e585e tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae" status: 200 len: 288 microversion: 2.1 time: 0.039357 Oct 14 18:01:29.091409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 399/786] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Oct 14 18:01:29 2022] GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:01:29.105065 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-56f4b0ca-00c6-4dfe-8402-bca1cdba6c7d tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da47f820>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:29.166799 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-56f4b0ca-00c6-4dfe-8402-bca1cdba6c7d tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae" status: 202 len: 0 microversion: 2.1 time: 0.065547 Oct 14 18:01:29.167371 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 388/787] 10.222.0.27 () {58 vars in 1254 bytes} [Fri Oct 14 18:01:29 2022] DELETE /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:01:29.177753 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3beda919-346d-42ac-8678-ed61933dc571 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da567310>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:29.212736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3beda919-346d-42ac-8678-ed61933dc571 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae" status: 200 len: 287 microversion: 2.1 time: 0.040087 Oct 14 18:01:29.218988 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 400/788] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Oct 14 18:01:29 2022] GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:29.897184 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:29.897795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:29.903770 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:29.904285 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:29.904725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:29.905416 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:29.905874 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:29.906302 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:30.037591 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:30.045749 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:30.047179 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:30.048754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ebb2792f-475e-42cf-b496-9914b085c373 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.156377 Oct 14 18:01:30.049515 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 389/789] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:29 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:30.063946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b77a2f75-de46-4a95-9e16-4c6efdaaf8e6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:30.064907 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b77a2f75-de46-4a95-9e16-4c6efdaaf8e6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:30.071867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b77a2f75-de46-4a95-9e16-4c6efdaaf8e6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:30.072387 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b77a2f75-de46-4a95-9e16-4c6efdaaf8e6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:30.072819 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b77a2f75-de46-4a95-9e16-4c6efdaaf8e6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:30.073506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b77a2f75-de46-4a95-9e16-4c6efdaaf8e6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:30.073953 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b77a2f75-de46-4a95-9e16-4c6efdaaf8e6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:30.074371 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b77a2f75-de46-4a95-9e16-4c6efdaaf8e6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:30.204052 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b77a2f75-de46-4a95-9e16-4c6efdaaf8e6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:30.212293 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b77a2f75-de46-4a95-9e16-4c6efdaaf8e6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1258 microversion: 2.1 time: 0.152220 Oct 14 18:01:30.212854 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 401/790] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:30 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:30.226123 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b2b6d280-4e72-4d96-9083-a91aa02910c2 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da47f820>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:30.250107 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-b2b6d280-4e72-4d96-9083-a91aa02910c2 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] HTTP exception thrown: Snapshot ff764e83-5185-4ae9-898f-16784c0a29ae could not be found. Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b2b6d280-4e72-4d96-9083-a91aa02910c2 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Request method failure captured: Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae HTTP/1.1 Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaP0OK0UygraVcg0Niz_dKwr4xjyo6RGvZ5BFBpHIpcrPxfInEb4XpgncYNAxKneZceQkPiFIJirMSZxLQcO2emr3falPx0pFkR2ZnxhB7oMV7-3m5-5QD9F7g6gTARP-hItvaCI7Wd8wFSi9cL7O3vYzdbsEU0vCIldIiWE-LsaAiA Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: d559f9074d014d0aa22b1346dc439bc5 Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:30.252970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d559f9074d014d0aa22b1346dc439bc5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: d559f9074d014d0aa22b1346dc439bc5 Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-VolumesSnapshotsTestJSON-1717054828-project Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 0550e66e44eb4e4e80b3513341087faa Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1717054828-project Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Snapshot ff764e83-5185-4ae9-898f-16784c0a29ae could not be found. Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'ff764e83-5185-4ae9-898f-16784c0a29ae'} Oct 14 18:01:30.254447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ff764e83-5185-4ae9-898f-16784c0a29ae could not be found. (HTTP 404) (Request-ID: req-cc9cd875-1d0b-4e7f-b664-32457dec906e) Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:30.255311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 18:01:30.256793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ff764e83-5185-4ae9-898f-16784c0a29ae could not be found. Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 14 18:01:30.258231 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ff764e83-5185-4ae9-898f-16784c0a29ae could not be found. Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ff764e83-5185-4ae9-898f-16784c0a29ae could not be found. Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b2b6d280-4e72-4d96-9083-a91aa02910c2 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Returning 404 to user: Snapshot ff764e83-5185-4ae9-898f-16784c0a29ae could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:30.259702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b2b6d280-4e72-4d96-9083-a91aa02910c2 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae" status: 404 len: 111 microversion: 2.1 time: 0.032112 Oct 14 18:01:30.260724 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 390/791] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Oct 14 18:01:30 2022] GET /compute/v2.1/os-snapshots/ff764e83-5185-4ae9-898f-16784c0a29ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:01:30.262862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-faaa862c-3882-4283-b5da-e130f064694c tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da5ecb80>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:30.323034 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-faaa862c-3882-4283-b5da-e130f064694c tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00" status: 202 len: 0 microversion: 2.1 time: 0.063809 Oct 14 18:01:30.323630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 402/792] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Oct 14 18:01:30 2022] DELETE /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:01:30.332497 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a7ee2b62-e869-40d2-91ae-b9aa32630e50 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da4fa040>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:30.381161 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a7ee2b62-e869-40d2-91ae-b9aa32630e50 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00" status: 200 len: 345 microversion: 2.1 time: 0.053141 Oct 14 18:01:30.381743 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 391/793] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 18:01:30 2022] GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:31.061797 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-6d6831e3-784f-47b8-96b0-4e6f06810b33 req-ab45ee9e-6f61-4974-932c-faca1192fc63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc764f20-1f93-4e6d-ac1a-588f161d6ee5", "name": "network-vif-plugged", "status": "completed", "tag": "8a708001-7ad4-4eed-9fae-7d4dbab749c6"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:31.072901 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-6d6831e3-784f-47b8-96b0-4e6f06810b33 req-ab45ee9e-6f61-4974-932c-faca1192fc63 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:31.073507 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-6d6831e3-784f-47b8-96b0-4e6f06810b33 req-ab45ee9e-6f61-4974-932c-faca1192fc63 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:31.073776 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-6d6831e3-784f-47b8-96b0-4e6f06810b33 req-ab45ee9e-6f61-4974-932c-faca1192fc63 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:31.074846 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:31.075461 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:31.082521 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:31.083017 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:31.083479 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:31.084223 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:31.084682 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:31.085110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:31.085979 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-6d6831e3-784f-47b8-96b0-4e6f06810b33 req-ab45ee9e-6f61-4974-932c-faca1192fc63 service nova] Creating event network-vif-plugged:8a708001-7ad4-4eed-9fae-7d4dbab749c6 for instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 on hv-cinder-74915 Oct 14 18:01:31.090840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-6d6831e3-784f-47b8-96b0-4e6f06810b33 req-ab45ee9e-6f61-4974-932c-faca1192fc63 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032769 Oct 14 18:01:31.091529 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 403/794] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:31.222877 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:31.231055 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:31.232745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:31.233917 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-40b1e68f-d80b-41a2-bf18-7c6057595af9 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.163676 Oct 14 18:01:31.234466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 392/795] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:31 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 18:01:31.235138 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a4aa2efa-0b82-4f9f-88c6-ef6ddd33dba5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:31.235830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a4aa2efa-0b82-4f9f-88c6-ef6ddd33dba5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:31.244549 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a4aa2efa-0b82-4f9f-88c6-ef6ddd33dba5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:31.245038 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a4aa2efa-0b82-4f9f-88c6-ef6ddd33dba5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:31.245469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a4aa2efa-0b82-4f9f-88c6-ef6ddd33dba5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:31.246172 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a4aa2efa-0b82-4f9f-88c6-ef6ddd33dba5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:31.246625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a4aa2efa-0b82-4f9f-88c6-ef6ddd33dba5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:31.247045 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a4aa2efa-0b82-4f9f-88c6-ef6ddd33dba5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:31.396385 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-323c8f52-b343-4419-a019-ff9767b732ec tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da4fa9d0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:31.407149 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a4aa2efa-0b82-4f9f-88c6-ef6ddd33dba5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:31.415707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a4aa2efa-0b82-4f9f-88c6-ef6ddd33dba5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1441 microversion: 2.1 time: 0.184729 Oct 14 18:01:31.416226 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 404/796] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:31 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1441 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:01:31.425266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-323c8f52-b343-4419-a019-ff9767b732ec tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] HTTP exception thrown: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-323c8f52-b343-4419-a019-ff9767b732ec tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Request method failure captured: Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00 HTTP/1.1 Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaP0OK0UygraVcg0Niz_dKwr4xjyo6RGvZ5BFBpHIpcrPxfInEb4XpgncYNAxKneZceQkPiFIJirMSZxLQcO2emr3falPx0pFkR2ZnxhB7oMV7-3m5-5QD9F7g6gTARP-hItvaCI7Wd8wFSi9cL7O3vYzdbsEU0vCIldIiWE-LsaAiA Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: d559f9074d014d0aa22b1346dc439bc5 Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:31.427215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d559f9074d014d0aa22b1346dc439bc5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: d559f9074d014d0aa22b1346dc439bc5 Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-VolumesSnapshotsTestJSON-1717054828-project Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 0550e66e44eb4e4e80b3513341087faa Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1717054828-project Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'd4951816-b17a-4d5f-882c-57fcea7f1c00'} Oct 14 18:01:31.428785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. (HTTP 404) (Request-ID: req-d2575bea-3a2a-42c4-905a-e627c2950376) Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:31.429651 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 18:01:31.430836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 18:01:31.432032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-323c8f52-b343-4419-a019-ff9767b732ec tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Returning 404 to user: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-323c8f52-b343-4419-a019-ff9767b732ec tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00" status: 404 len: 109 microversion: 2.1 time: 0.036752 Oct 14 18:01:31.433176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 393/797] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 18:01:31 2022] GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 18:01:31.437972 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-64fce1ca-3989-43ab-808b-53280d88cae4 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da47f280>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:31.438111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ed361790-02cc-43d1-a496-1bdb7bbabf4c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:31.438582 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ed361790-02cc-43d1-a496-1bdb7bbabf4c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:31.444550 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed361790-02cc-43d1-a496-1bdb7bbabf4c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:31.445073 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed361790-02cc-43d1-a496-1bdb7bbabf4c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:31.445458 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed361790-02cc-43d1-a496-1bdb7bbabf4c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:31.446148 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed361790-02cc-43d1-a496-1bdb7bbabf4c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:31.446599 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed361790-02cc-43d1-a496-1bdb7bbabf4c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:31.447016 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ed361790-02cc-43d1-a496-1bdb7bbabf4c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:31.469405 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-64fce1ca-3989-43ab-808b-53280d88cae4 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] HTTP exception thrown: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-64fce1ca-3989-43ab-808b-53280d88cae4 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Request method failure captured: Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: DELETE /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00 HTTP/1.1 Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaP0OK0UygraVcg0Niz_dKwr4xjyo6RGvZ5BFBpHIpcrPxfInEb4XpgncYNAxKneZceQkPiFIJirMSZxLQcO2emr3falPx0pFkR2ZnxhB7oMV7-3m5-5QD9F7g6gTARP-hItvaCI7Wd8wFSi9cL7O3vYzdbsEU0vCIldIiWE-LsaAiA Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: d559f9074d014d0aa22b1346dc439bc5 Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:31.472759 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d559f9074d014d0aa22b1346dc439bc5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: d559f9074d014d0aa22b1346dc439bc5 Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-VolumesSnapshotsTestJSON-1717054828-project Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 0550e66e44eb4e4e80b3513341087faa Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1717054828-project Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'd4951816-b17a-4d5f-882c-57fcea7f1c00'} Oct 14 18:01:31.474357 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. (HTTP 404) (Request-ID: req-c1b247f0-cff1-40fd-a8a0-04142078d353) Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:31.475281 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 18:01:31.476707 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 18:01:31.478232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-64fce1ca-3989-43ab-808b-53280d88cae4 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Returning 404 to user: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-64fce1ca-3989-43ab-808b-53280d88cae4 tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00" status: 404 len: 109 microversion: 2.1 time: 0.040044 Oct 14 18:01:31.479540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 394/798] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Oct 14 18:01:31 2022] DELETE /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 18:01:31.483553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0a3dccf4-f2fa-4d34-80c3-b266612acb2a tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Calling method '.version_select at 0x7fe3da56aca0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:31.511675 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-0a3dccf4-f2fa-4d34-80c3-b266612acb2a tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] HTTP exception thrown: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0a3dccf4-f2fa-4d34-80c3-b266612acb2a tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Request method failure captured: Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00 HTTP/1.1 Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaP0OK0UygraVcg0Niz_dKwr4xjyo6RGvZ5BFBpHIpcrPxfInEb4XpgncYNAxKneZceQkPiFIJirMSZxLQcO2emr3falPx0pFkR2ZnxhB7oMV7-3m5-5QD9F7g6gTARP-hItvaCI7Wd8wFSi9cL7O3vYzdbsEU0vCIldIiWE-LsaAiA Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: d559f9074d014d0aa22b1346dc439bc5 Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:31.513798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d559f9074d014d0aa22b1346dc439bc5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d559f9074d014d0aa22b1346dc439bc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: d559f9074d014d0aa22b1346dc439bc5 Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1717054828 Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-VolumesSnapshotsTestJSON-1717054828-project Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 0550e66e44eb4e4e80b3513341087faa Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1717054828-project Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'd4951816-b17a-4d5f-882c-57fcea7f1c00'} Oct 14 18:01:31.515246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. (HTTP 404) (Request-ID: req-8098ea18-de64-4f61-b6cf-5cb69215ad79) Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:31.516047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 18:01:31.517176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 18:01:31.519502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0a3dccf4-f2fa-4d34-80c3-b266612acb2a tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] Returning 404 to user: Volume d4951816-b17a-4d5f-882c-57fcea7f1c00 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0a3dccf4-f2fa-4d34-80c3-b266612acb2a tempest-VolumesSnapshotsTestJSON-1717054828 tempest-VolumesSnapshotsTestJSON-1717054828-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00" status: 404 len: 109 microversion: 2.1 time: 0.036057 Oct 14 18:01:31.520669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 395/799] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 18:01:31 2022] GET /compute/v2.1/os-volumes/d4951816-b17a-4d5f-882c-57fcea7f1c00 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 18:01:31.588302 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ed361790-02cc-43d1-a496-1bdb7bbabf4c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:31.596855 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ed361790-02cc-43d1-a496-1bdb7bbabf4c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1441 microversion: 2.1 time: 0.162574 Oct 14 18:01:31.597426 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 405/800] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:31 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1441 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:32.261022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:32.262764 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:32.270271 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:32.271754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:32.272676 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:32.273584 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:32.274205 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:32.274792 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:32.496102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:32.518790 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:32.522776 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:32.525885 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f8273609-a80b-4ec4-9a5c-2d4264fd8450 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.270030 Oct 14 18:01:32.526450 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 396/801] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:32 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:01:32.616524 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f9523e79-fb80-426a-a001-bcac67d8a530 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:32.617812 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f9523e79-fb80-426a-a001-bcac67d8a530 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:32.625129 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9523e79-fb80-426a-a001-bcac67d8a530 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:32.625909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9523e79-fb80-426a-a001-bcac67d8a530 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:32.626507 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9523e79-fb80-426a-a001-bcac67d8a530 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:32.628696 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9523e79-fb80-426a-a001-bcac67d8a530 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:32.629498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9523e79-fb80-426a-a001-bcac67d8a530 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:32.630087 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9523e79-fb80-426a-a001-bcac67d8a530 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:32.656533 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f9523e79-fb80-426a-a001-bcac67d8a530 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/ips" status: 200 len: 150 microversion: 2.1 time: 0.043798 Oct 14 18:01:32.660731 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 406/802] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Oct 14 18:01:32 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:33.379584 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7930ba00-3583-43be-92d2-41cd7212b400 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Action: 'create', calling method: .version_select at 0x7fe3da50a160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-530108096", "metadata": {"Type": "work"}}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7930ba00-3583-43be-92d2-41cd7212b400 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Request method failure captured: Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 121 Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaP9N3ZaxBhavB32WsjeznuEDUYfAZw7eSW7TFBuujpvcVYe--RUkWKUSv3NYip2Lxb1nE_PCUj8wdcAOY_atywC1sDiyESl2lR82I-BeU2w7sVWPuOq6L-lJgUdmCX7WmGJZdl7IhvS-wNz8LnhCFz92ssCMqLaNcb2YyuNegtm0EA Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:33.394645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e6cfbee34834449ba1cc2ad96f7fb4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: e80621a13eca4e43aaaa1079c4915acc Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-530108096", "metadata": {"Type": "work"}}} Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: Oct 14 18:01:33.396444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-530108096', 'metadata': {'Type': 'work'}}}} Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise error Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi '#$%' Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:33.397404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 18:01:33.399031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 18:01:33.400572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 18:01:33.400572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.402800 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7930ba00-3583-43be-92d2-41cd7212b400 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:33.404409 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7930ba00-3583-43be-92d2-41cd7212b400 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.244964 Oct 14 18:01:33.405782 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 397/803] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Oct 14 18:01:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 18:01:33.417943 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3da71069-a5e1-4800-8a9f-b377557cf0ef tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Action: 'create', calling method: .version_select at 0x7fe3da60edc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-565894096", "metadata": {"Type": "work"}}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3da71069-a5e1-4800-8a9f-b377557cf0ef tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Request method failure captured: Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 119 Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaP9N3ZaxBhavB32WsjeznuEDUYfAZw7eSW7TFBuujpvcVYe--RUkWKUSv3NYip2Lxb1nE_PCUj8wdcAOY_atywC1sDiyESl2lR82I-BeU2w7sVWPuOq6L-lJgUdmCX7WmGJZdl7IhvS-wNz8LnhCFz92ssCMqLaNcb2YyuNegtm0EA Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:01:33.425852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e6cfbee34834449ba1cc2ad96f7fb4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: e80621a13eca4e43aaaa1079c4915acc Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-565894096", "metadata": {"Type": "work"}}} Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: Oct 14 18:01:33.427440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-565894096', 'metadata': {'Type': 'work'}}}} Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise error Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi '0' Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:33.429012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 18:01:33.431649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 18:01:33.433203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 18:01:33.433203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.433203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3da71069-a5e1-4800-8a9f-b377557cf0ef tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:33.433203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3da71069-a5e1-4800-8a9f-b377557cf0ef tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016679 Oct 14 18:01:33.433203 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 407/804] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Oct 14 18:01:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 18:01:33.439142 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-043a0ea8-e241-4691-81fc-19c38c70e34d tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Action: 'create', calling method: .version_select at 0x7fe3da4ccee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1683418661", "metadata": {"Type": "work"}}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-043a0ea8-e241-4691-81fc-19c38c70e34d tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Request method failure captured: Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 119 Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaP9N3ZaxBhavB32WsjeznuEDUYfAZw7eSW7TFBuujpvcVYe--RUkWKUSv3NYip2Lxb1nE_PCUj8wdcAOY_atywC1sDiyESl2lR82I-BeU2w7sVWPuOq6L-lJgUdmCX7WmGJZdl7IhvS-wNz8LnhCFz92ssCMqLaNcb2YyuNegtm0EA Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:33.443266 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e6cfbee34834449ba1cc2ad96f7fb4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: e80621a13eca4e43aaaa1079c4915acc Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1683418661", "metadata": {"Type": "work"}}} Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: Oct 14 18:01:33.444984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1683418661', 'metadata': {'Type': 'work'}}}} Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise error Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi '' Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:33.445965 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 18:01:33.447556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 18:01:33.448994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 18:01:33.448994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.448994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-043a0ea8-e241-4691-81fc-19c38c70e34d tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:33.448994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-043a0ea8-e241-4691-81fc-19c38c70e34d tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011717 Oct 14 18:01:33.450037 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 398/805] 10.222.0.27 () {60 vars in 1156 bytes} [Fri Oct 14 18:01:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 18:01:33.458332 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a153a692-7219-4d76-8daf-dfc132d6df82 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Calling method '.version_select at 0x7fe3da567b80>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:33.492808 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-a153a692-7219-4d76-8daf-dfc132d6df82 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] HTTP exception thrown: Volume tempest-invalid-2016281524 could not be found. Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a153a692-7219-4d76-8daf-dfc132d6df82 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Request method failure captured: Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2016281524 HTTP/1.1 Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaP9N3ZaxBhavB32WsjeznuEDUYfAZw7eSW7TFBuujpvcVYe--RUkWKUSv3NYip2Lxb1nE_PCUj8wdcAOY_atywC1sDiyESl2lR82I-BeU2w7sVWPuOq6L-lJgUdmCX7WmGJZdl7IhvS-wNz8LnhCFz92ssCMqLaNcb2YyuNegtm0EA Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:01:33.497101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e6cfbee34834449ba1cc2ad96f7fb4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: e80621a13eca4e43aaaa1079c4915acc Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Volume tempest-invalid-2016281524 could not be found. Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'tempest-invalid-2016281524'} Oct 14 18:01:33.498677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2016281524 could not be found. (HTTP 404) (Request-ID: req-59bdc1ce-19db-46d0-b82c-e699be8c711b) Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.499638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 18:01:33.501231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2016281524 could not be found. Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:33.502616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2016281524 could not be found. Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2016281524 could not be found. Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a153a692-7219-4d76-8daf-dfc132d6df82 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Returning 404 to user: Volume tempest-invalid-2016281524 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a153a692-7219-4d76-8daf-dfc132d6df82 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2016281524" status: 404 len: 99 microversion: 2.1 time: 0.044305 Oct 14 18:01:33.504080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 408/806] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Oct 14 18:01:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2016281524 => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 14 18:01:33.511610 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f69ded7f-6ef6-4881-9e36-d392bea360b9 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003740 Oct 14 18:01:33.512176 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 399/807] 10.222.0.27 () {58 vars in 1140 bytes} [Fri Oct 14 18:01:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 14 18:01:33.521610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ac20ab87-6825-4e9e-8a40-fca3bb1313c9 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004107 Oct 14 18:01:33.522315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 409/808] 10.222.0.27 () {58 vars in 1137 bytes} [Fri Oct 14 18:01:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 14 18:01:33.531330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-12648304-823f-4d27-8c00-1214ccc9b2dc tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Calling method '.version_select at 0x7fe3da4ccd30>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:33.554803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:33.557442 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:33.564463 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:33.565199 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:33.565791 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:33.567110 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:33.568071 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:33.568666 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:33.571330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-12648304-823f-4d27-8c00-1214ccc9b2dc tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] HTTP exception thrown: Volume 20a77ede-92c2-4acf-a939-c0a350b02119 could not be found. Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-12648304-823f-4d27-8c00-1214ccc9b2dc tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Request method failure captured: Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: DELETE /compute/v2.1/os-volumes/20a77ede-92c2-4acf-a939-c0a350b02119 HTTP/1.1 Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaP9N3ZaxBhavB32WsjeznuEDUYfAZw7eSW7TFBuujpvcVYe--RUkWKUSv3NYip2Lxb1nE_PCUj8wdcAOY_atywC1sDiyESl2lR82I-BeU2w7sVWPuOq6L-lJgUdmCX7WmGJZdl7IhvS-wNz8LnhCFz92ssCMqLaNcb2YyuNegtm0EA Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:33.573824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e6cfbee34834449ba1cc2ad96f7fb4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: e80621a13eca4e43aaaa1079c4915acc Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Volume 20a77ede-92c2-4acf-a939-c0a350b02119 could not be found. Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': '20a77ede-92c2-4acf-a939-c0a350b02119'} Oct 14 18:01:33.575463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20a77ede-92c2-4acf-a939-c0a350b02119 could not be found. (HTTP 404) (Request-ID: req-f102f6e6-fffb-4bc8-9ea7-bd44109d0efd) Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.576496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 18:01:33.577858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20a77ede-92c2-4acf-a939-c0a350b02119 could not be found. Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 18:01:33.579204 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20a77ede-92c2-4acf-a939-c0a350b02119 could not be found. Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20a77ede-92c2-4acf-a939-c0a350b02119 could not be found. Oct 14 18:01:33.581186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.589150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-12648304-823f-4d27-8c00-1214ccc9b2dc tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Returning 404 to user: Volume 20a77ede-92c2-4acf-a939-c0a350b02119 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:33.589150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-12648304-823f-4d27-8c00-1214ccc9b2dc tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/20a77ede-92c2-4acf-a939-c0a350b02119" status: 404 len: 109 microversion: 2.1 time: 0.055742 Oct 14 18:01:33.589150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 400/809] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Oct 14 18:01:33 2022] DELETE /compute/v2.1/os-volumes/20a77ede-92c2-4acf-a939-c0a350b02119 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:01:33.602252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1e552fd7-0852-4e4b-b732-92a1759611d2 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Calling method '.version_select at 0x7fe3da47faf0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:33.643377 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-1e552fd7-0852-4e4b-b732-92a1759611d2 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] HTTP exception thrown: Volume 82e8c9fd-69ff-4d79-a34f-61c2b18196e4 could not be found. Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1e552fd7-0852-4e4b-b732-92a1759611d2 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Request method failure captured: Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/os-volumes/82e8c9fd-69ff-4d79-a34f-61c2b18196e4 HTTP/1.1 Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaP9N3ZaxBhavB32WsjeznuEDUYfAZw7eSW7TFBuujpvcVYe--RUkWKUSv3NYip2Lxb1nE_PCUj8wdcAOY_atywC1sDiyESl2lR82I-BeU2w7sVWPuOq6L-lJgUdmCX7WmGJZdl7IhvS-wNz8LnhCFz92ssCMqLaNcb2YyuNegtm0EA Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:01:33.645592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2e6cfbee34834449ba1cc2ad96f7fb4e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2e6cfbee34834449ba1cc2ad96f7fb4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 2e6cfbee34834449ba1cc2ad96f7fb4e Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-VolumesNegativeTest-794798454 Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: e80621a13eca4e43aaaa1079c4915acc Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-VolumesNegativeTest-794798454-project Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Volume 82e8c9fd-69ff-4d79-a34f-61c2b18196e4 could not be found. Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': '82e8c9fd-69ff-4d79-a34f-61c2b18196e4'} Oct 14 18:01:33.647252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 82e8c9fd-69ff-4d79-a34f-61c2b18196e4 could not be found. (HTTP 404) (Request-ID: req-b2878dea-b8c4-4883-b029-e228ee35ca8b) Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.648557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 18:01:33.650024 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 82e8c9fd-69ff-4d79-a34f-61c2b18196e4 could not be found. Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 18:01:33.651449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 82e8c9fd-69ff-4d79-a34f-61c2b18196e4 could not be found. Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 82e8c9fd-69ff-4d79-a34f-61c2b18196e4 could not be found. Oct 14 18:01:33.653276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:01:33.656705 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1e552fd7-0852-4e4b-b732-92a1759611d2 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] Returning 404 to user: Volume 82e8c9fd-69ff-4d79-a34f-61c2b18196e4 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:01:33.656705 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1e552fd7-0852-4e4b-b732-92a1759611d2 tempest-VolumesNegativeTest-794798454 tempest-VolumesNegativeTest-794798454-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/82e8c9fd-69ff-4d79-a34f-61c2b18196e4" status: 404 len: 109 microversion: 2.1 time: 0.063249 Oct 14 18:01:33.657200 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 401/810] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 18:01:33 2022] GET /compute/v2.1/os-volumes/82e8c9fd-69ff-4d79-a34f-61c2b18196e4 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:01:33.950165 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:33.958887 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:33.960510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:33.961854 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-26a6cc94-c90d-4507-8ab3-2f8e7cab468c tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1732 microversion: 2.20 time: 0.412076 Oct 14 18:01:33.976080 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 410/811] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:33 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1732 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 18:01:34.193352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9bf7a70f-67fa-41a4-aae7-5305bdf6f67e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:34.196978 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9bf7a70f-67fa-41a4-aae7-5305bdf6f67e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:34.221274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bf7a70f-67fa-41a4-aae7-5305bdf6f67e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:34.221908 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bf7a70f-67fa-41a4-aae7-5305bdf6f67e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:34.222959 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bf7a70f-67fa-41a4-aae7-5305bdf6f67e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:34.223942 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bf7a70f-67fa-41a4-aae7-5305bdf6f67e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:34.224620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bf7a70f-67fa-41a4-aae7-5305bdf6f67e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:34.225075 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9bf7a70f-67fa-41a4-aae7-5305bdf6f67e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:34.282012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-ddcecc99-12d0-4789-bbd9-3f5d12b95be9 req-0641442c-5b76-4524-8abe-6a85e8367124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28431df1-6972-4ad5-b90c-c1dcb54d5a98", "tag": "f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:34.296925 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-ddcecc99-12d0-4789-bbd9-3f5d12b95be9 req-0641442c-5b76-4524-8abe-6a85e8367124 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:34.297249 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-ddcecc99-12d0-4789-bbd9-3f5d12b95be9 req-0641442c-5b76-4524-8abe-6a85e8367124 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:34.297842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-ddcecc99-12d0-4789-bbd9-3f5d12b95be9 req-0641442c-5b76-4524-8abe-6a85e8367124 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:34.312005 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-ddcecc99-12d0-4789-bbd9-3f5d12b95be9 req-0641442c-5b76-4524-8abe-6a85e8367124 service nova] Creating event network-changed:f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf for instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 on hv-cinder-74915 Oct 14 18:01:34.318600 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-ddcecc99-12d0-4789-bbd9-3f5d12b95be9 req-0641442c-5b76-4524-8abe-6a85e8367124 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040115 Oct 14 18:01:34.319839 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 411/812] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:34.612437 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9bf7a70f-67fa-41a4-aae7-5305bdf6f67e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422010 Oct 14 18:01:34.621466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 402/813] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 18:01:34 2022] POST /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:34.991013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:34.991735 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:34.998757 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:34.999236 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:34.999660 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:35.000661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:35.001105 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:35.001695 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:35.178981 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:35.188694 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:35.191526 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:35.192920 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5732ba3f-6625-4bd5-afd8-9365bddec9ed tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1719 microversion: 2.20 time: 0.208341 Oct 14 18:01:35.193487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 412/814] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:01:34 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1719 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 18:01:41.156233 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c2a0afda-48b6-49b4-b739-e75da2e8858c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: .version_select at 0x7fe3da50aca0>, body: {"keypair": {"name": "tempest-keypair-749420262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTROxXDmDaYrqlSeMIASisZmzhwjWMnC4eYCbMjBd9BaMtWlUSH3T9gy74BYexeZV6L8JBJeJT1f0o9Ab0vynCJ9Q+u2T2Dy/OucWaG0YhU50mps/U27+PPvby/Bfk2TQ=="}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:41.163969 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:41.176192 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-c2a0afda-48b6-49b4-b739-e75da2e8858c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:01:41.180265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-c2a0afda-48b6-49b4-b739-e75da2e8858c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for user 3a0657648d244f12ab76c068b38e641b and project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:01:41.203805 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c2a0afda-48b6-49b4-b739-e75da2e8858c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052221 Oct 14 18:01:41.204573 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 403/815] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Oct 14 18:01:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:42.533860 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-563037282", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2dc29fa6-a064-4dfe-be69-6fc039570894"}], "security_groups": [{"name": "tempest-securitygroup--1039318545"}], "key_name": "tempest-keypair-749420262", "user_data": "}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:42.543596 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:42.645668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] validate_networks() for [('2dc29fa6-a064-4dfe-be69-6fc039570894', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 18:01:43.044221 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 18:01:43.044643 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 18:01:43.045151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 18:01:43.045551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 18:01:43.046257 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 18:01:43.056921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:43.057763 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:43.058264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:43.058998 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:43.059444 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:43.059919 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:43.076910 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:01:43.081449 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for user 3a0657648d244f12ab76c068b38e641b and project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:01:43.093483 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 18:01:43.096366 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 18:01:43.144952 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e70030a3-19bc-42d8-bbd1-38f0bfaae440 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.616044 Oct 14 18:01:43.145906 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 413/816] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 18:01:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 18:01:43.157334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b7fe77a0-4805-4e4d-9184-692630150470 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:43.158069 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-b7fe77a0-4805-4e4d-9184-692630150470 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:43.252567 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-b7fe77a0-4805-4e4d-9184-692630150470 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:43.275480 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b7fe77a0-4805-4e4d-9184-692630150470 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1240 microversion: 2.1 time: 0.111471 Oct 14 18:01:43.276447 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 404/817] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:43 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1240 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:44.301847 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f9faec8a-c8cd-4304-90de-e7f1ca2698a6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:44.302466 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f9faec8a-c8cd-4304-90de-e7f1ca2698a6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:44.309420 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9faec8a-c8cd-4304-90de-e7f1ca2698a6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:44.309866 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9faec8a-c8cd-4304-90de-e7f1ca2698a6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:44.310301 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9faec8a-c8cd-4304-90de-e7f1ca2698a6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:44.310990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9faec8a-c8cd-4304-90de-e7f1ca2698a6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:44.311436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9faec8a-c8cd-4304-90de-e7f1ca2698a6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:44.311858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f9faec8a-c8cd-4304-90de-e7f1ca2698a6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:44.404504 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f9faec8a-c8cd-4304-90de-e7f1ca2698a6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:44.413440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f9faec8a-c8cd-4304-90de-e7f1ca2698a6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1292 microversion: 2.1 time: 0.118741 Oct 14 18:01:44.414016 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 414/818] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:44 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1292 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:45.437970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d926b516-33d2-4737-9006-b2eb9ac4b501 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:45.439360 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d926b516-33d2-4737-9006-b2eb9ac4b501 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:45.443596 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:45.452439 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d926b516-33d2-4737-9006-b2eb9ac4b501 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:45.453016 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d926b516-33d2-4737-9006-b2eb9ac4b501 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:45.453967 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d926b516-33d2-4737-9006-b2eb9ac4b501 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:45.455055 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d926b516-33d2-4737-9006-b2eb9ac4b501 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:45.458293 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d926b516-33d2-4737-9006-b2eb9ac4b501 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:45.458967 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d926b516-33d2-4737-9006-b2eb9ac4b501 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:45.719856 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d926b516-33d2-4737-9006-b2eb9ac4b501 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:45.729100 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d926b516-33d2-4737-9006-b2eb9ac4b501 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1366 microversion: 2.1 time: 0.295476 Oct 14 18:01:45.744518 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 405/819] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:45 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:45.946497 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-d5305676-d2d7-4362-b1d7-4829135879b7 req-2b131c8c-c28e-40d4-a294-0c59d5c1a5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caefe50f-f313-490e-9dcc-5c6715233c61", "tag": "49f0f8c5-3e42-4143-820a-d45552f7481e"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:45.961624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-d5305676-d2d7-4362-b1d7-4829135879b7 req-2b131c8c-c28e-40d4-a294-0c59d5c1a5b6 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:45.962525 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-d5305676-d2d7-4362-b1d7-4829135879b7 req-2b131c8c-c28e-40d4-a294-0c59d5c1a5b6 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:45.963198 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-d5305676-d2d7-4362-b1d7-4829135879b7 req-2b131c8c-c28e-40d4-a294-0c59d5c1a5b6 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:45.977213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-d5305676-d2d7-4362-b1d7-4829135879b7 req-2b131c8c-c28e-40d4-a294-0c59d5c1a5b6 service nova] Creating event network-changed:49f0f8c5-3e42-4143-820a-d45552f7481e for instance caefe50f-f313-490e-9dcc-5c6715233c61 on hv-cinder-74915 Oct 14 18:01:45.982682 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-d5305676-d2d7-4362-b1d7-4829135879b7 req-2b131c8c-c28e-40d4-a294-0c59d5c1a5b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039597 Oct 14 18:01:45.983289 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 415/820] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:01:46.753613 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-30240a48-8cec-4bac-9564-a6a2f6a79435 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:46.754140 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-30240a48-8cec-4bac-9564-a6a2f6a79435 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:46.760636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-30240a48-8cec-4bac-9564-a6a2f6a79435 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:46.761120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-30240a48-8cec-4bac-9564-a6a2f6a79435 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:46.761575 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-30240a48-8cec-4bac-9564-a6a2f6a79435 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:46.762244 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-30240a48-8cec-4bac-9564-a6a2f6a79435 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:46.762701 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-30240a48-8cec-4bac-9564-a6a2f6a79435 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:46.763118 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-30240a48-8cec-4bac-9564-a6a2f6a79435 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:46.896018 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-30240a48-8cec-4bac-9564-a6a2f6a79435 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:46.903536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-30240a48-8cec-4bac-9564-a6a2f6a79435 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1366 microversion: 2.1 time: 0.154349 Oct 14 18:01:46.904126 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 406/821] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:46 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:47.928298 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d3bec676-1a10-4748-b03f-90637db43387 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:47.928992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d3bec676-1a10-4748-b03f-90637db43387 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:47.935508 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3bec676-1a10-4748-b03f-90637db43387 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:47.936010 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3bec676-1a10-4748-b03f-90637db43387 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:47.936437 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3bec676-1a10-4748-b03f-90637db43387 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:47.937108 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3bec676-1a10-4748-b03f-90637db43387 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:47.937548 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3bec676-1a10-4748-b03f-90637db43387 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:47.937966 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3bec676-1a10-4748-b03f-90637db43387 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:48.067245 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d3bec676-1a10-4748-b03f-90637db43387 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:48.070681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=100 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:48.075835 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d3bec676-1a10-4748-b03f-90637db43387 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1366 microversion: 2.1 time: 0.152544 Oct 14 18:01:48.076413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 416/822] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:47 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:49.099824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-45afb26d-452a-4e28-8995-f02b21ac97b8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:49.101095 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-45afb26d-452a-4e28-8995-f02b21ac97b8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:49.109083 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45afb26d-452a-4e28-8995-f02b21ac97b8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:49.109902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45afb26d-452a-4e28-8995-f02b21ac97b8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:49.110401 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45afb26d-452a-4e28-8995-f02b21ac97b8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:49.111168 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45afb26d-452a-4e28-8995-f02b21ac97b8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:49.112421 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45afb26d-452a-4e28-8995-f02b21ac97b8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:49.113017 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45afb26d-452a-4e28-8995-f02b21ac97b8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:49.261332 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-45afb26d-452a-4e28-8995-f02b21ac97b8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:49.269201 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-45afb26d-452a-4e28-8995-f02b21ac97b8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1366 microversion: 2.1 time: 0.173982 Oct 14 18:01:49.269769 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 407/823] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:49 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:50.292275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-61c63cea-3596-4c96-9876-e8e38beda691 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:50.292887 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-61c63cea-3596-4c96-9876-e8e38beda691 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:50.299322 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-61c63cea-3596-4c96-9876-e8e38beda691 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:50.300210 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-61c63cea-3596-4c96-9876-e8e38beda691 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:50.300647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-61c63cea-3596-4c96-9876-e8e38beda691 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:50.301328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-61c63cea-3596-4c96-9876-e8e38beda691 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:50.301769 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-61c63cea-3596-4c96-9876-e8e38beda691 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:50.302180 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-61c63cea-3596-4c96-9876-e8e38beda691 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:50.438540 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-61c63cea-3596-4c96-9876-e8e38beda691 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:50.446803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-61c63cea-3596-4c96-9876-e8e38beda691 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1366 microversion: 2.1 time: 0.158361 Oct 14 18:01:50.447452 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 417/824] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:50 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:51.121861 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-065fbb9f-d53c-4e84-be6f-b7e227195694 req-a4a0c36b-7969-427f-889f-d94b9675e049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caefe50f-f313-490e-9dcc-5c6715233c61", "name": "network-vif-plugged", "status": "completed", "tag": "49f0f8c5-3e42-4143-820a-d45552f7481e"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:51.133931 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-065fbb9f-d53c-4e84-be6f-b7e227195694 req-a4a0c36b-7969-427f-889f-d94b9675e049 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:51.134630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-065fbb9f-d53c-4e84-be6f-b7e227195694 req-a4a0c36b-7969-427f-889f-d94b9675e049 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:51.135068 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-065fbb9f-d53c-4e84-be6f-b7e227195694 req-a4a0c36b-7969-427f-889f-d94b9675e049 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:51.148727 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-065fbb9f-d53c-4e84-be6f-b7e227195694 req-a4a0c36b-7969-427f-889f-d94b9675e049 service nova] Creating event network-vif-plugged:49f0f8c5-3e42-4143-820a-d45552f7481e for instance caefe50f-f313-490e-9dcc-5c6715233c61 on hv-cinder-74915 Oct 14 18:01:51.154019 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-065fbb9f-d53c-4e84-be6f-b7e227195694 req-a4a0c36b-7969-427f-889f-d94b9675e049 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035828 Oct 14 18:01:51.154837 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 408/825] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:51.470356 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-9300b385-92c5-4bba-b297-86ffd981c20c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:51.471708 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-9300b385-92c5-4bba-b297-86ffd981c20c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:51.478474 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9300b385-92c5-4bba-b297-86ffd981c20c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:51.478968 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9300b385-92c5-4bba-b297-86ffd981c20c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:51.479409 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9300b385-92c5-4bba-b297-86ffd981c20c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:51.480147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9300b385-92c5-4bba-b297-86ffd981c20c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:51.480601 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9300b385-92c5-4bba-b297-86ffd981c20c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:51.481031 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-9300b385-92c5-4bba-b297-86ffd981c20c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:51.612543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-9300b385-92c5-4bba-b297-86ffd981c20c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:51.620251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-9300b385-92c5-4bba-b297-86ffd981c20c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1366 microversion: 2.1 time: 0.154560 Oct 14 18:01:51.620716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 418/826] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:51 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:52.648110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2b8fcb5e-21c1-4107-9c08-02b0831cf24a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:52.648727 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2b8fcb5e-21c1-4107-9c08-02b0831cf24a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:52.654930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b8fcb5e-21c1-4107-9c08-02b0831cf24a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:52.655413 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b8fcb5e-21c1-4107-9c08-02b0831cf24a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:52.655852 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b8fcb5e-21c1-4107-9c08-02b0831cf24a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:52.656617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b8fcb5e-21c1-4107-9c08-02b0831cf24a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:52.657074 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b8fcb5e-21c1-4107-9c08-02b0831cf24a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:52.657500 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b8fcb5e-21c1-4107-9c08-02b0831cf24a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:52.798210 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2b8fcb5e-21c1-4107-9c08-02b0831cf24a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:52.807218 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2b8fcb5e-21c1-4107-9c08-02b0831cf24a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1366 microversion: 2.1 time: 0.163978 Oct 14 18:01:52.807792 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 409/827] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:52 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:53.832436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-31547a16-b2c8-4ee2-826a-81d663eca0de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:53.833012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-31547a16-b2c8-4ee2-826a-81d663eca0de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:53.835217 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:53.835866 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:53.842333 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-31547a16-b2c8-4ee2-826a-81d663eca0de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:53.842808 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-31547a16-b2c8-4ee2-826a-81d663eca0de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:53.843234 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-31547a16-b2c8-4ee2-826a-81d663eca0de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:53.843950 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-31547a16-b2c8-4ee2-826a-81d663eca0de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:53.844396 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-31547a16-b2c8-4ee2-826a-81d663eca0de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:53.844810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-31547a16-b2c8-4ee2-826a-81d663eca0de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:53.980156 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-31547a16-b2c8-4ee2-826a-81d663eca0de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:01:53.989611 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-31547a16-b2c8-4ee2-826a-81d663eca0de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1556 microversion: 2.1 time: 0.161477 Oct 14 18:01:53.990459 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 419/828] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:01:53 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:01:54.013278 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-099163cd-437c-4176-8ed0-1771e61b3bc2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:01:54.013748 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-099163cd-437c-4176-8ed0-1771e61b3bc2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:01:54.015669 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=6 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:54.022546 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-099163cd-437c-4176-8ed0-1771e61b3bc2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:54.023022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-099163cd-437c-4176-8ed0-1771e61b3bc2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:54.023450 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-099163cd-437c-4176-8ed0-1771e61b3bc2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:54.024178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-099163cd-437c-4176-8ed0-1771e61b3bc2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:54.024664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-099163cd-437c-4176-8ed0-1771e61b3bc2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:54.025058 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-099163cd-437c-4176-8ed0-1771e61b3bc2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:54.103308 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-099163cd-437c-4176-8ed0-1771e61b3bc2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093791 Oct 14 18:01:54.103924 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 410/829] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Oct 14 18:01:54 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:01:55.330079 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-9a3890f1-868e-4d22-ae30-03c958b6a93b req-60350038-2c54-401e-87cd-246618f3ec0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caefe50f-f313-490e-9dcc-5c6715233c61", "tag": "49f0f8c5-3e42-4143-820a-d45552f7481e"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:01:55.340564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-9a3890f1-868e-4d22-ae30-03c958b6a93b req-60350038-2c54-401e-87cd-246618f3ec0a service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:01:55.341122 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-9a3890f1-868e-4d22-ae30-03c958b6a93b req-60350038-2c54-401e-87cd-246618f3ec0a service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:01:55.341552 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-9a3890f1-868e-4d22-ae30-03c958b6a93b req-60350038-2c54-401e-87cd-246618f3ec0a service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:01:55.354033 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-9a3890f1-868e-4d22-ae30-03c958b6a93b req-60350038-2c54-401e-87cd-246618f3ec0a service nova] Creating event network-changed:49f0f8c5-3e42-4143-820a-d45552f7481e for instance caefe50f-f313-490e-9dcc-5c6715233c61 on hv-cinder-74915 Oct 14 18:01:55.359136 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-9a3890f1-868e-4d22-ae30-03c958b6a93b req-60350038-2c54-401e-87cd-246618f3ec0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032671 Oct 14 18:01:55.359779 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 420/830] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:13.877089 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:13.877930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=30 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:13.882898 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4acd7c5a-072b-442d-a98b-f92c178bdaa7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:13.885187 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4acd7c5a-072b-442d-a98b-f92c178bdaa7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:13.893790 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4acd7c5a-072b-442d-a98b-f92c178bdaa7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:13.894367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4acd7c5a-072b-442d-a98b-f92c178bdaa7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:13.894812 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4acd7c5a-072b-442d-a98b-f92c178bdaa7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:13.895741 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4acd7c5a-072b-442d-a98b-f92c178bdaa7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:13.896338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4acd7c5a-072b-442d-a98b-f92c178bdaa7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:13.896819 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4acd7c5a-072b-442d-a98b-f92c178bdaa7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:13.929015 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4acd7c5a-072b-442d-a98b-f92c178bdaa7 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053916 Oct 14 18:02:13.929570 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 411/831] 10.222.0.27 () {60 vars in 1343 bytes} [Fri Oct 14 18:02:13 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:13.997493 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:13.998219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=20 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:14.002661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bf67d586-4dc8-4c59-8a69-e25e2f05b601 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:14.003232 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bf67d586-4dc8-4c59-8a69-e25e2f05b601 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:14.012831 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf67d586-4dc8-4c59-8a69-e25e2f05b601 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:14.013368 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf67d586-4dc8-4c59-8a69-e25e2f05b601 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:14.013799 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf67d586-4dc8-4c59-8a69-e25e2f05b601 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:14.014488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf67d586-4dc8-4c59-8a69-e25e2f05b601 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:14.015034 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf67d586-4dc8-4c59-8a69-e25e2f05b601 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:14.015460 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf67d586-4dc8-4c59-8a69-e25e2f05b601 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:14.042190 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bf67d586-4dc8-4c59-8a69-e25e2f05b601 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:02:14.123822 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bf67d586-4dc8-4c59-8a69-e25e2f05b601 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 204 len: 0 microversion: 2.20 time: 0.128120 Oct 14 18:02:14.124664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 421/832] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Oct 14 18:02:13 2022] DELETE /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 18:02:14.132841 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:14.133453 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:14.139444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:14.140133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:14.140502 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:14.141273 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:14.142054 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:14.142531 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:14.276195 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:14.291220 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:14.292069 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:14.293506 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0a22a182-3d5e-4a08-b822-8664f2905f42 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.164562 Oct 14 18:02:14.296116 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 412/833] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:02:14 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:02:15.320076 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:15.320770 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:15.327072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:15.327546 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:15.328008 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:15.328693 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:15.329143 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:15.329567 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:15.466703 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:15.475779 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:15.477233 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:15.478388 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-72e691a7-4838-4f85-84fb-3c3125126421 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1725 microversion: 2.20 time: 0.162653 Oct 14 18:02:15.478952 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 422/834] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:02:15 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:02:16.505213 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:16.506499 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:16.512917 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:16.513402 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:16.513840 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:16.514539 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:16.515023 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:16.515449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:16.620226 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:16.627630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:16.629165 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9187955c3cf4b77ba86e67a6f378e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d62defa42436cbcc5e712c62b76f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:16.630417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f0dbb47f-be01-4eda-9d53-8c2a8f5da51b tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 200 len: 1657 microversion: 2.20 time: 0.129193 Oct 14 18:02:16.651581 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 413/835] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:02:16 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 1657 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 18:02:16.734656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-10d77494-e477-4ad3-9ce4-f33b03b2555f req-475461cf-dcdf-4432-bdfb-00f175dac9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc764f20-1f93-4e6d-ac1a-588f161d6ee5", "name": "network-vif-deleted", "tag": "8a708001-7ad4-4eed-9fae-7d4dbab749c6"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:02:16.746293 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-10d77494-e477-4ad3-9ce4-f33b03b2555f req-475461cf-dcdf-4432-bdfb-00f175dac9f9 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:16.746806 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-10d77494-e477-4ad3-9ce4-f33b03b2555f req-475461cf-dcdf-4432-bdfb-00f175dac9f9 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:16.747230 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-10d77494-e477-4ad3-9ce4-f33b03b2555f req-475461cf-dcdf-4432-bdfb-00f175dac9f9 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:16.759838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-10d77494-e477-4ad3-9ce4-f33b03b2555f req-475461cf-dcdf-4432-bdfb-00f175dac9f9 service nova] Creating event network-vif-deleted:8a708001-7ad4-4eed-9fae-7d4dbab749c6 for instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 on hv-cinder-74915 Oct 14 18:02:16.765999 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-10d77494-e477-4ad3-9ce4-f33b03b2555f req-475461cf-dcdf-4432-bdfb-00f175dac9f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034861 Oct 14 18:02:16.766480 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 423/836] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:17.658924 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:17.659554 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:17.666548 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:17.667032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:17.667464 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:17.668199 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:17.668646 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:17.669068 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:17.683843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] HTTP exception thrown: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Request method failure captured: Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 HTTP/1.1 Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaKDv4hRuhlp7e0CvXFseoQcs1wl5PoyKJURIXVfRv3nrRWq0BZJGV6685-PYkgfUGZCNOerZDnJRnhCm9TzOrKIjyljnaRXT1DbfYIBbQY8Z9NK9JQoDFA00VhVCgBE3dsO0bYal6mMKtACtktZuOfy4QXjuVSwQhwpaN3Ht63HEx8 Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:02:17.685725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_261d62defa42436cbcc5e712c62b76f4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: b9187955c3cf4b77ba86e67a6f378e6a Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:17.687455 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'fc764f20-1f93-4e6d-ac1a-588f161d6ee5'} Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:02:17.688445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:17.689992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:17.691619 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Returning 404 to user: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:02:17.691619 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-40e1be62-f806-4245-a071-1000f8ecfe22 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 404 len: 111 microversion: 2.20 time: 0.032355 Oct 14 18:02:17.691619 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 414/837] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:02:17 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 18:02:17.697679 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3b1cc58b-46f3-4782-bf96-16cc77eb2baf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '.version_select at 0x7fe3da57d0d0>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:17.728457 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3b1cc58b-46f3-4782-bf96-16cc77eb2baf tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724033438" status: 204 len: 0 microversion: 2.20 time: 0.035654 Oct 14 18:02:17.729054 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 424/838] 10.222.0.27 () {60 vars in 1262 bytes} [Fri Oct 14 18:02:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724033438 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 14 18:02:19.518156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:19.519213 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:19.538400 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:19.538885 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:19.539317 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:19.540066 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:19.540781 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:19.540969 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:19.558139 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] HTTP exception thrown: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Request method failure captured: Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: DELETE /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 HTTP/1.1 Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaKDv4hRuhlp7e0CvXFseoQcs1wl5PoyKJURIXVfRv3nrRWq0BZJGV6685-PYkgfUGZCNOerZDnJRnhCm9TzOrKIjyljnaRXT1DbfYIBbQY8Z9NK9JQoDFA00VhVCgBE3dsO0bYal6mMKtACtktZuOfy4QXjuVSwQhwpaN3Ht63HEx8 Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:02:19.559691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_261d62defa42436cbcc5e712c62b76f4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: b9187955c3cf4b77ba86e67a6f378e6a Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:19.561362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'fc764f20-1f93-4e6d-ac1a-588f161d6ee5'} Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:02:19.562351 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:19.563795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:19.565324 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Returning 404 to user: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:02:19.565324 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f6d694dd-c28e-4399-b2bc-3b38e32ae173 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 404 len: 111 microversion: 2.20 time: 0.047039 Oct 14 18:02:19.565324 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 415/839] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Oct 14 18:02:19 2022] DELETE /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 14 18:02:19.570985 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:19.571730 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: fc764f20-1f93-4e6d-ac1a-588f161d6ee5] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:19.578741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:19.579340 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:19.579773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:19.580494 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:19.580947 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:19.581364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:19.595013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] HTTP exception thrown: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Request method failure captured: Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 HTTP/1.1 Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaKDv4hRuhlp7e0CvXFseoQcs1wl5PoyKJURIXVfRv3nrRWq0BZJGV6685-PYkgfUGZCNOerZDnJRnhCm9TzOrKIjyljnaRXT1DbfYIBbQY8Z9NK9JQoDFA00VhVCgBE3dsO0bYal6mMKtACtktZuOfy4QXjuVSwQhwpaN3Ht63HEx8 Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:02:19.596712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_261d62defa42436cbcc5e712c62b76f4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: b9187955c3cf4b77ba86e67a6f378e6a Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:19.598291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'fc764f20-1f93-4e6d-ac1a-588f161d6ee5'} Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:02:19.599127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. Oct 14 18:02:19.600916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:19.602321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Returning 404 to user: Instance fc764f20-1f93-4e6d-ac1a-588f161d6ee5 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:02:19.602321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b0bb11eb-baeb-4078-a6ba-64c16faf594d tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5" status: 404 len: 111 microversion: 2.20 time: 0.032245 Oct 14 18:02:19.602321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 425/840] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:02:19 2022] GET /compute/v2.1/servers/fc764f20-1f93-4e6d-ac1a-588f161d6ee5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 18:02:20.746119 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:20.746653 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:20.753042 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:20.753525 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:20.753960 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:20.754684 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:20.755136 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:20.756240 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:20.769380 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] HTTP exception thrown: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Request method failure captured: Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: DELETE /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b HTTP/1.1 Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaKDv4hRuhlp7e0CvXFseoQcs1wl5PoyKJURIXVfRv3nrRWq0BZJGV6685-PYkgfUGZCNOerZDnJRnhCm9TzOrKIjyljnaRXT1DbfYIBbQY8Z9NK9JQoDFA00VhVCgBE3dsO0bYal6mMKtACtktZuOfy4QXjuVSwQhwpaN3Ht63HEx8 Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:02:20.770913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_261d62defa42436cbcc5e712c62b76f4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: b9187955c3cf4b77ba86e67a6f378e6a Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 18:02:20.772553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': '58c0a43e-1109-4ff9-9617-8a2958de7b0b'} Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:02:20.774133 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 18:02:20.775673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:20.777340 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Returning 404 to user: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:02:20.777340 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-816e392d-6ac3-411a-a076-db0afd9d1015 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 404 len: 111 microversion: 2.20 time: 0.030142 Oct 14 18:02:20.777340 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 416/841] 10.222.0.27 () {60 vars in 1280 bytes} [Fri Oct 14 18:02:20 2022] DELETE /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 18:02:20.780828 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:20.781429 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] [instance: 58c0a43e-1109-4ff9-9617-8a2958de7b0b] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:20.788058 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:20.788466 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:20.788887 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:20.789566 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:20.790007 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:20.790448 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:20.803933 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] HTTP exception thrown: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Request method failure captured: Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b HTTP/1.1 Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaKDv4hRuhlp7e0CvXFseoQcs1wl5PoyKJURIXVfRv3nrRWq0BZJGV6685-PYkgfUGZCNOerZDnJRnhCm9TzOrKIjyljnaRXT1DbfYIBbQY8Z9NK9JQoDFA00VhVCgBE3dsO0bYal6mMKtACtktZuOfy4QXjuVSwQhwpaN3Ht63HEx8 Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:02:20.805436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_261d62defa42436cbcc5e712c62b76f4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/261d62defa42436cbcc5e712c62b76f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 261d62defa42436cbcc5e712c62b76f4 Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158725756 Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: b9187955c3cf4b77ba86e67a6f378e6a Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158725756-project Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 18:02:20.807111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '58c0a43e-1109-4ff9-9617-8a2958de7b0b'} Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:02:20.808213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. Oct 14 18:02:20.809732 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:20.811184 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] Returning 404 to user: Instance 58c0a43e-1109-4ff9-9617-8a2958de7b0b could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:02:20.811184 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-cfff2243-4b36-4e16-bafe-e0b82460e1e3 tempest-AttachVolumeShelveTestJSON-1158725756 tempest-AttachVolumeShelveTestJSON-1158725756-project] 10.222.0.27 "GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b" status: 404 len: 111 microversion: 2.20 time: 0.029787 Oct 14 18:02:20.811184 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 426/842] 10.222.0.27 () {60 vars in 1277 bytes} [Fri Oct 14 18:02:20 2022] GET /compute/v2.1/servers/58c0a43e-1109-4ff9-9617-8a2958de7b0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 18:02:26.687648 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d1e66aa0-7e08-4247-bea8-cc8eb1fb5af6 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da47fee0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:26.734602 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d1e66aa0-7e08-4247-bea8-cc8eb1fb5af6 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e5f06260-3f92-487e-a0b4-ccc90c2c5bd1" status: 200 len: 350 microversion: 2.1 time: 0.050712 Oct 14 18:02:26.735155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 417/843] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 18:02:26 2022] GET /compute/v2.1/os-volumes/e5f06260-3f92-487e-a0b4-ccc90c2c5bd1 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:28.069285 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-cf78d398-0be3-49ad-86dc-17ef73a72c11 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da59e280>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:28.116565 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-cf78d398-0be3-49ad-86dc-17ef73a72c11 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6abc6e39-28bf-410d-8ffb-6e9513f88b5b" status: 200 len: 351 microversion: 2.1 time: 0.050312 Oct 14 18:02:28.117274 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 427/844] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 18:02:28 2022] GET /compute/v2.1/os-volumes/6abc6e39-28bf-410d-8ffb-6e9513f88b5b => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:31.563431 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=12 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:31.564213 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=24 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:31.568392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f1c55181-f98b-4954-ae03-8e7c132ddd9c tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da4a8430>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:31.619214 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f1c55181-f98b-4954-ae03-8e7c132ddd9c tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ea9f2a64-4857-4afe-ac45-43125420c5c2" status: 200 len: 351 microversion: 2.1 time: 0.057161 Oct 14 18:02:31.619818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 418/845] 10.222.0.27 () {58 vars in 1245 bytes} [Fri Oct 14 18:02:31 2022] GET /compute/v2.1/os-volumes/ea9f2a64-4857-4afe-ac45-43125420c5c2 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:31.631323 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:31.632959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:31.643489 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-12caf82d-71e2-4cb1-8d6c-b5add4ae2de5 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da5ec820>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:31.737142 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-12caf82d-71e2-4cb1-8d6c-b5add4ae2de5 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.107925 Oct 14 18:02:31.737964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 428/846] 10.222.0.27 () {58 vars in 1134 bytes} [Fri Oct 14 18:02:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:31.752711 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9f6f9645-aee8-423a-9d04-a212f63052c4 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da5d6280>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:31.840026 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9f6f9645-aee8-423a-9d04-a212f63052c4 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090996 Oct 14 18:02:31.840668 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 419/847] 10.222.0.27 () {58 vars in 1149 bytes} [Fri Oct 14 18:02:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:31.855044 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-1702136f-7ba2-4664-a10d-5a8eb7faf912 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da567ca0>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:31.938331 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-1702136f-7ba2-4664-a10d-5a8eb7faf912 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087626 Oct 14 18:02:31.938901 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 429/848] 10.222.0.27 () {58 vars in 1134 bytes} [Fri Oct 14 18:02:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:31.952486 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fbb3241c-d545-43c0-ad21-1f087f42d921 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da4a84c0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:32.038899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fbb3241c-d545-43c0-ad21-1f087f42d921 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090008 Oct 14 18:02:32.039486 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 420/849] 10.222.0.27 () {58 vars in 1167 bytes} [Fri Oct 14 18:02:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:32.054096 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-68cc8c84-51c7-41d8-bd22-e41b52bea242 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da4e6310>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:32.137806 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-68cc8c84-51c7-41d8-bd22-e41b52bea242 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088156 Oct 14 18:02:32.138392 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 430/850] 10.222.0.27 () {58 vars in 1170 bytes} [Fri Oct 14 18:02:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:32.153513 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c34ad987-add8-4257-817a-9ddd34a6a5f7 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da6cac10>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:32.234668 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c34ad987-add8-4257-817a-9ddd34a6a5f7 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084942 Oct 14 18:02:32.235316 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 421/851] 10.222.0.27 () {58 vars in 1155 bytes} [Fri Oct 14 18:02:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:32.249466 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c26b69d2-2df5-4931-a5ad-2864675b2b46 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da4ef040>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:32.337198 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c26b69d2-2df5-4931-a5ad-2864675b2b46 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091377 Oct 14 18:02:32.337845 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 431/852] 10.222.0.27 () {58 vars in 1188 bytes} [Fri Oct 14 18:02:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:32.352878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d2ac2e7c-20c6-4d33-802e-44239463cb22 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] Calling method '.version_select at 0x7fe3da6bc4c0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:32.436509 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d2ac2e7c-20c6-4d33-802e-44239463cb22 tempest-VolumesTestJSON-1346308517 tempest-VolumesTestJSON-1346308517-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088586 Oct 14 18:02:32.437065 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 422/853] 10.222.0.27 () {58 vars in 1155 bytes} [Fri Oct 14 18:02:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:39.070045 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-095b0e74-88ae-4b3f-9a5d-e31fa553964e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:39.070651 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-095b0e74-88ae-4b3f-9a5d-e31fa553964e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:39.076622 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-095b0e74-88ae-4b3f-9a5d-e31fa553964e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:39.077093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-095b0e74-88ae-4b3f-9a5d-e31fa553964e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:39.077517 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-095b0e74-88ae-4b3f-9a5d-e31fa553964e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:39.078194 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-095b0e74-88ae-4b3f-9a5d-e31fa553964e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:39.078638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-095b0e74-88ae-4b3f-9a5d-e31fa553964e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:39.079055 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-095b0e74-88ae-4b3f-9a5d-e31fa553964e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:39.101926 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-095b0e74-88ae-4b3f-9a5d-e31fa553964e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61/ips" status: 200 len: 150 microversion: 2.1 time: 0.037063 Oct 14 18:02:39.103603 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 432/854] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Oct 14 18:02:39 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:39.114518 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:02:39.118081 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:39.124903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:39.125386 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:39.125811 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:39.126500 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:39.126947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:39.127361 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:39.211025 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Invalid volume: volume 70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05 is already attached to instances: 8bbbe808-1a08-42f9-b3eb-101761f16451 Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: POST /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61/os-volume_attachments HTTP/1.1 Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 74 Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:02:39.212664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {"volumeAttachment": {"volumeId": "70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05"}} Oct 14 18:02:39.214300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Invalid volume: volume 70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05 is already attached to instances: 8bbbe808-1a08-42f9-b3eb-101761f16451 Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'server_id': 'caefe50f-f313-490e-9dcc-5c6715233c61', 'body': {'volumeAttachment': {'volumeId': '70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05'}}} Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05 is already attached to instances: 8bbbe808-1a08-42f9-b3eb-101761f16451 Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:39.215197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05 is already attached to instances: 8bbbe808-1a08-42f9-b3eb-101761f16451 Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:39.216729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:39.218532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:39.218532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:02:39.218532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:02:39.218532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05 is already attached to instances: 8bbbe808-1a08-42f9-b3eb-101761f16451 Oct 14 18:02:39.218532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:39.218532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 400 to user: Invalid volume: volume 70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05 is already attached to instances: 8bbbe808-1a08-42f9-b3eb-101761f16451 {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:02:39.218532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-12d26596-8190-478e-94f9-651414a1cb8b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103998 Oct 14 18:02:39.218532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 423/855] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 18:02:39 2022] POST /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 18:02:39.223777 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-505fb449-4606-48ac-87f2-eccf7c74f527 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:39.224305 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-505fb449-4606-48ac-87f2-eccf7c74f527 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:39.231159 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-505fb449-4606-48ac-87f2-eccf7c74f527 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:39.231659 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-505fb449-4606-48ac-87f2-eccf7c74f527 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:39.232146 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-505fb449-4606-48ac-87f2-eccf7c74f527 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:39.232890 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-505fb449-4606-48ac-87f2-eccf7c74f527 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:39.233362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-505fb449-4606-48ac-87f2-eccf7c74f527 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:39.233788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-505fb449-4606-48ac-87f2-eccf7c74f527 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:39.260014 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-505fb449-4606-48ac-87f2-eccf7c74f527 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:02:39.344477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-505fb449-4606-48ac-87f2-eccf7c74f527 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 204 len: 0 microversion: 2.1 time: 0.124998 Oct 14 18:02:39.354688 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a1cd44a2-f299-4261-8f5c-c489d3212513 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:39.355364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a1cd44a2-f299-4261-8f5c-c489d3212513 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:39.355965 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 433/856] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:02:39 2022] DELETE /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:02:39.362194 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1cd44a2-f299-4261-8f5c-c489d3212513 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:39.362672 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1cd44a2-f299-4261-8f5c-c489d3212513 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:39.363105 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1cd44a2-f299-4261-8f5c-c489d3212513 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:39.363787 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1cd44a2-f299-4261-8f5c-c489d3212513 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:39.364265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1cd44a2-f299-4261-8f5c-c489d3212513 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:39.364680 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a1cd44a2-f299-4261-8f5c-c489d3212513 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:39.519899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a1cd44a2-f299-4261-8f5c-c489d3212513 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:39.529091 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a1cd44a2-f299-4261-8f5c-c489d3212513 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1681 microversion: 2.1 time: 0.179370 Oct 14 18:02:39.529657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 424/857] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:39 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:40.557788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8d291f59-9670-4dbf-93d9-b9607be4bac6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:40.558490 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8d291f59-9670-4dbf-93d9-b9607be4bac6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:40.565436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8d291f59-9670-4dbf-93d9-b9607be4bac6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:40.565912 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8d291f59-9670-4dbf-93d9-b9607be4bac6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:40.566334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8d291f59-9670-4dbf-93d9-b9607be4bac6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:40.567029 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8d291f59-9670-4dbf-93d9-b9607be4bac6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:40.567468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8d291f59-9670-4dbf-93d9-b9607be4bac6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:40.567927 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8d291f59-9670-4dbf-93d9-b9607be4bac6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:40.704461 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-8d291f59-9670-4dbf-93d9-b9607be4bac6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:40.713279 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8d291f59-9670-4dbf-93d9-b9607be4bac6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1681 microversion: 2.1 time: 0.160178 Oct 14 18:02:40.713843 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 434/858] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:40 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:41.736953 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a6db4e40-a591-4424-9f96-bfe0955e3fdc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:41.737516 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a6db4e40-a591-4424-9f96-bfe0955e3fdc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:41.743899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a6db4e40-a591-4424-9f96-bfe0955e3fdc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:41.744389 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a6db4e40-a591-4424-9f96-bfe0955e3fdc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:41.744824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a6db4e40-a591-4424-9f96-bfe0955e3fdc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:41.745530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a6db4e40-a591-4424-9f96-bfe0955e3fdc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:41.745983 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a6db4e40-a591-4424-9f96-bfe0955e3fdc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:41.746404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a6db4e40-a591-4424-9f96-bfe0955e3fdc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:41.811298 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-2af2fd76-b8f3-44ea-95b2-84ad6e47fdf6 req-9f99c39b-401e-49ad-8fa4-2db9f06227f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caefe50f-f313-490e-9dcc-5c6715233c61", "name": "network-vif-deleted", "tag": "49f0f8c5-3e42-4143-820a-d45552f7481e"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:02:41.821977 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2af2fd76-b8f3-44ea-95b2-84ad6e47fdf6 req-9f99c39b-401e-49ad-8fa4-2db9f06227f4 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:41.822543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2af2fd76-b8f3-44ea-95b2-84ad6e47fdf6 req-9f99c39b-401e-49ad-8fa4-2db9f06227f4 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:41.823031 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-2af2fd76-b8f3-44ea-95b2-84ad6e47fdf6 req-9f99c39b-401e-49ad-8fa4-2db9f06227f4 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:41.831535 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a6db4e40-a591-4424-9f96-bfe0955e3fdc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:41.835691 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-2af2fd76-b8f3-44ea-95b2-84ad6e47fdf6 req-9f99c39b-401e-49ad-8fa4-2db9f06227f4 service nova] Creating event network-vif-deleted:49f0f8c5-3e42-4143-820a-d45552f7481e for instance caefe50f-f313-490e-9dcc-5c6715233c61 on hv-cinder-74915 Oct 14 18:02:41.842132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-2af2fd76-b8f3-44ea-95b2-84ad6e47fdf6 req-9f99c39b-401e-49ad-8fa4-2db9f06227f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 Oct 14 18:02:41.846023 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 435/859] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:41.847458 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a6db4e40-a591-4424-9f96-bfe0955e3fdc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1613 microversion: 2.1 time: 0.114263 Oct 14 18:02:41.860530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 425/860] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:41 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1613 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:42.876016 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-49445c8e-58eb-46f9-893f-799b2a3cbd2e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:42.876819 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-49445c8e-58eb-46f9-893f-799b2a3cbd2e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:42.883382 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49445c8e-58eb-46f9-893f-799b2a3cbd2e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:42.884079 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49445c8e-58eb-46f9-893f-799b2a3cbd2e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:42.884599 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49445c8e-58eb-46f9-893f-799b2a3cbd2e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:42.885291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49445c8e-58eb-46f9-893f-799b2a3cbd2e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:42.885740 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49445c8e-58eb-46f9-893f-799b2a3cbd2e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:42.886265 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49445c8e-58eb-46f9-893f-799b2a3cbd2e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:42.948769 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-49445c8e-58eb-46f9-893f-799b2a3cbd2e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:42.957563 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-49445c8e-58eb-46f9-893f-799b2a3cbd2e tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1325 microversion: 2.1 time: 0.087216 Oct 14 18:02:42.958145 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 436/861] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:42 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1325 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:43.981515 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:43.982269 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:43.988981 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:43.989469 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:43.989901 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:43.990600 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:43.991051 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:43.991653 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:44.024199 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:44.024678 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:44.025661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:44.026323 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lazy-loading 'fault' on Instance uuid caefe50f-f313-490e-9dcc-5c6715233c61 {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:02:44.078623 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:44.086484 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-905bef35-7574-4d0b-9a07-97e0675dce01 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 200 len: 1330 microversion: 2.1 time: 0.109635 Oct 14 18:02:44.087039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 426/862] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:43 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:45.111347 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:45.112089 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:45.118351 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:45.118833 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:45.119461 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:45.120196 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:45.120647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:45.121072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:45.134276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 HTTP/1.1 Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:02:45.136803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:02:45.138386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'caefe50f-f313-490e-9dcc-5c6715233c61'} Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:02:45.139291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:02:45.140782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:02:45.142628 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:02:45.142628 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7ba5bbf0-845f-49c5-8b0e-39d407bc002c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 404 len: 111 microversion: 2.1 time: 0.030820 Oct 14 18:02:45.142628 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 437/863] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:45 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:02:45.147921 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c50fc65b-f707-4877-8fae-8eb41203d52c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '.version_select at 0x7fe3da47f430>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:45.167889 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c50fc65b-f707-4877-8fae-8eb41203d52c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749420262" status: 202 len: 0 microversion: 2.1 time: 0.024297 Oct 14 18:02:45.168489 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 427/864] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Oct 14 18:02:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749420262 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:02:45.862497 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-71c9d76a-e9e3-4b83-9130-11e1a38bfc04 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:45.862997 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-71c9d76a-e9e3-4b83-9130-11e1a38bfc04 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:45.869013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-71c9d76a-e9e3-4b83-9130-11e1a38bfc04 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:45.869643 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-71c9d76a-e9e3-4b83-9130-11e1a38bfc04 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:45.869956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-71c9d76a-e9e3-4b83-9130-11e1a38bfc04 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:45.870651 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-71c9d76a-e9e3-4b83-9130-11e1a38bfc04 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:45.871103 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-71c9d76a-e9e3-4b83-9130-11e1a38bfc04 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:45.871530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-71c9d76a-e9e3-4b83-9130-11e1a38bfc04 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:45.951661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-71c9d76a-e9e3-4b83-9130-11e1a38bfc04 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lazy-loading 'services' on Instance uuid 8bbbe808-1a08-42f9-b3eb-101761f16451 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:02:46.024289 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-71c9d76a-e9e3-4b83-9130-11e1a38bfc04 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments/70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05" status: 202 len: 0 microversion: 2.1 time: 0.165670 Oct 14 18:02:46.025028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 438/865] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 18:02:45 2022] DELETE /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments/70afa0f5-9dcb-4ac0-a3a7-847cd7c70d05 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:02:46.035150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0324f60c-3b5a-41fb-b283-f6b22e52b7f0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:46.037320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0324f60c-3b5a-41fb-b283-f6b22e52b7f0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:46.045490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0324f60c-3b5a-41fb-b283-f6b22e52b7f0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:46.045994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0324f60c-3b5a-41fb-b283-f6b22e52b7f0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:46.046604 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0324f60c-3b5a-41fb-b283-f6b22e52b7f0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:46.047299 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0324f60c-3b5a-41fb-b283-f6b22e52b7f0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:46.047753 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0324f60c-3b5a-41fb-b283-f6b22e52b7f0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:46.048203 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0324f60c-3b5a-41fb-b283-f6b22e52b7f0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:46.084851 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0324f60c-3b5a-41fb-b283-f6b22e52b7f0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053658 Oct 14 18:02:46.085771 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 428/866] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:02:46 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:02:47.099575 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a78bf429-4b86-402f-b208-0607de7a6761 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:47.101827 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a78bf429-4b86-402f-b208-0607de7a6761 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:47.108499 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a78bf429-4b86-402f-b208-0607de7a6761 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:47.108980 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a78bf429-4b86-402f-b208-0607de7a6761 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:47.109417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a78bf429-4b86-402f-b208-0607de7a6761 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:47.110107 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a78bf429-4b86-402f-b208-0607de7a6761 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:47.110561 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a78bf429-4b86-402f-b208-0607de7a6761 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:47.110984 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a78bf429-4b86-402f-b208-0607de7a6761 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:47.142181 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a78bf429-4b86-402f-b208-0607de7a6761 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047095 Oct 14 18:02:47.142960 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 439/867] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:02:47 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:48.155333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-9dc96a7c-3f69-4bfb-9dff-31de96527fec tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:48.157668 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-9dc96a7c-3f69-4bfb-9dff-31de96527fec tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:48.166606 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dc96a7c-3f69-4bfb-9dff-31de96527fec tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:48.167102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dc96a7c-3f69-4bfb-9dff-31de96527fec tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:48.167564 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dc96a7c-3f69-4bfb-9dff-31de96527fec tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:48.169396 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dc96a7c-3f69-4bfb-9dff-31de96527fec tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:48.169854 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dc96a7c-3f69-4bfb-9dff-31de96527fec tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:48.170443 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-9dc96a7c-3f69-4bfb-9dff-31de96527fec tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:48.201620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-9dc96a7c-3f69-4bfb-9dff-31de96527fec tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050209 Oct 14 18:02:48.202180 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 429/868] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:02:48 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:49.214231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4750db4f-0acb-43c8-aa60-9b223dbfaa22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:49.216457 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4750db4f-0acb-43c8-aa60-9b223dbfaa22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:49.222785 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4750db4f-0acb-43c8-aa60-9b223dbfaa22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:49.223259 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4750db4f-0acb-43c8-aa60-9b223dbfaa22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:49.223684 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4750db4f-0acb-43c8-aa60-9b223dbfaa22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:49.224384 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4750db4f-0acb-43c8-aa60-9b223dbfaa22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:49.224829 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4750db4f-0acb-43c8-aa60-9b223dbfaa22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:49.225241 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4750db4f-0acb-43c8-aa60-9b223dbfaa22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:49.254156 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4750db4f-0acb-43c8-aa60-9b223dbfaa22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Oct 14 18:02:49.254691 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 440/869] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:02:49 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:50.267784 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3e328ef9-b505-4f44-b6b5-9ddaf33b9603 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:50.269980 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3e328ef9-b505-4f44-b6b5-9ddaf33b9603 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:50.277066 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e328ef9-b505-4f44-b6b5-9ddaf33b9603 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:50.277551 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e328ef9-b505-4f44-b6b5-9ddaf33b9603 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:50.277988 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e328ef9-b505-4f44-b6b5-9ddaf33b9603 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:50.278678 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e328ef9-b505-4f44-b6b5-9ddaf33b9603 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:50.279172 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e328ef9-b505-4f44-b6b5-9ddaf33b9603 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:50.279596 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3e328ef9-b505-4f44-b6b5-9ddaf33b9603 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:50.308316 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3e328ef9-b505-4f44-b6b5-9ddaf33b9603 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044571 Oct 14 18:02:50.308936 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 430/870] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:02:50 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:51.320687 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-cdc93e95-9839-43dc-8d16-c52259d68a99 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:51.323321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-cdc93e95-9839-43dc-8d16-c52259d68a99 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:51.329758 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdc93e95-9839-43dc-8d16-c52259d68a99 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:51.330233 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdc93e95-9839-43dc-8d16-c52259d68a99 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:51.330663 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdc93e95-9839-43dc-8d16-c52259d68a99 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:51.331342 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdc93e95-9839-43dc-8d16-c52259d68a99 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:51.331784 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdc93e95-9839-43dc-8d16-c52259d68a99 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:51.332228 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cdc93e95-9839-43dc-8d16-c52259d68a99 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:51.361847 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-cdc93e95-9839-43dc-8d16-c52259d68a99 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Oct 14 18:02:51.362401 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 441/871] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:02:51 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:52.375189 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3827fd79-9dd7-4456-a9f3-a078d99e0f2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:52.377417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3827fd79-9dd7-4456-a9f3-a078d99e0f2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:52.383754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3827fd79-9dd7-4456-a9f3-a078d99e0f2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:52.384269 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3827fd79-9dd7-4456-a9f3-a078d99e0f2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:52.384727 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3827fd79-9dd7-4456-a9f3-a078d99e0f2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:52.386064 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3827fd79-9dd7-4456-a9f3-a078d99e0f2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:52.386523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3827fd79-9dd7-4456-a9f3-a078d99e0f2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:52.386952 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3827fd79-9dd7-4456-a9f3-a078d99e0f2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:52.416261 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3827fd79-9dd7-4456-a9f3-a078d99e0f2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044636 Oct 14 18:02:52.416852 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 431/872] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:02:52 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 18:02:52.486809 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-49d7f919-cd76-4adf-8570-e5b3f443cb86 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:52.487344 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-49d7f919-cd76-4adf-8570-e5b3f443cb86 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:52.493562 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49d7f919-cd76-4adf-8570-e5b3f443cb86 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:52.494039 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49d7f919-cd76-4adf-8570-e5b3f443cb86 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:52.494466 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49d7f919-cd76-4adf-8570-e5b3f443cb86 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:52.495807 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49d7f919-cd76-4adf-8570-e5b3f443cb86 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:52.496156 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49d7f919-cd76-4adf-8570-e5b3f443cb86 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:52.496570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-49d7f919-cd76-4adf-8570-e5b3f443cb86 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:52.522499 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-49d7f919-cd76-4adf-8570-e5b3f443cb86 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:02:52.607894 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-49d7f919-cd76-4adf-8570-e5b3f443cb86 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 204 len: 0 microversion: 2.1 time: 0.123447 Oct 14 18:02:52.608503 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 442/873] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:02:52 2022] DELETE /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:02:52.618520 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8ff8c0bb-8355-4fb0-8185-f50a4d61508b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:52.619145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8ff8c0bb-8355-4fb0-8185-f50a4d61508b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:52.626573 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ff8c0bb-8355-4fb0-8185-f50a4d61508b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:52.627288 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ff8c0bb-8355-4fb0-8185-f50a4d61508b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:52.627725 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ff8c0bb-8355-4fb0-8185-f50a4d61508b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:52.628533 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ff8c0bb-8355-4fb0-8185-f50a4d61508b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:52.628999 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ff8c0bb-8355-4fb0-8185-f50a4d61508b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:52.629451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8ff8c0bb-8355-4fb0-8185-f50a4d61508b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:52.774953 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8ff8c0bb-8355-4fb0-8185-f50a4d61508b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:52.782842 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8ff8c0bb-8355-4fb0-8185-f50a4d61508b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1681 microversion: 2.1 time: 0.168620 Oct 14 18:02:52.783414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 432/874] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:52 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:02:53.809491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-89b369c8-cfa6-4d72-bd81-c4a015b34803 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:53.810176 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-89b369c8-cfa6-4d72-bd81-c4a015b34803 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:53.816431 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b369c8-cfa6-4d72-bd81-c4a015b34803 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:53.816900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b369c8-cfa6-4d72-bd81-c4a015b34803 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:53.817323 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b369c8-cfa6-4d72-bd81-c4a015b34803 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:53.817996 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b369c8-cfa6-4d72-bd81-c4a015b34803 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:53.818436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b369c8-cfa6-4d72-bd81-c4a015b34803 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:53.818849 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-89b369c8-cfa6-4d72-bd81-c4a015b34803 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:53.948872 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-89b369c8-cfa6-4d72-bd81-c4a015b34803 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:53.956469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-89b369c8-cfa6-4d72-bd81-c4a015b34803 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1681 microversion: 2.1 time: 0.151831 Oct 14 18:02:53.957026 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 443/875] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:53 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:54.980347 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-607f744a-e332-40fa-9eb3-308cea7ca6d1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:54.980995 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-607f744a-e332-40fa-9eb3-308cea7ca6d1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:54.987427 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-607f744a-e332-40fa-9eb3-308cea7ca6d1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:54.987936 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-607f744a-e332-40fa-9eb3-308cea7ca6d1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:54.988374 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-607f744a-e332-40fa-9eb3-308cea7ca6d1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:54.989071 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-607f744a-e332-40fa-9eb3-308cea7ca6d1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:54.989526 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-607f744a-e332-40fa-9eb3-308cea7ca6d1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:54.989949 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-607f744a-e332-40fa-9eb3-308cea7ca6d1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:55.084037 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-607f744a-e332-40fa-9eb3-308cea7ca6d1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:55.092325 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-607f744a-e332-40fa-9eb3-308cea7ca6d1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 200 len: 1614 microversion: 2.1 time: 0.115960 Oct 14 18:02:55.092843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 433/876] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:54 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:55.206222 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-aebcf6c6-ee7e-465b-9d89-2a3731e1a72a req-50b49e14-d4c0-4c96-8a6b-c076a437472c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bbbe808-1a08-42f9-b3eb-101761f16451", "name": "network-vif-deleted", "tag": "224c20a8-d471-41aa-9fb6-c77acab8e577"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:02:55.218733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-aebcf6c6-ee7e-465b-9d89-2a3731e1a72a req-50b49e14-d4c0-4c96-8a6b-c076a437472c service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:55.219435 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-aebcf6c6-ee7e-465b-9d89-2a3731e1a72a req-50b49e14-d4c0-4c96-8a6b-c076a437472c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:55.219868 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-aebcf6c6-ee7e-465b-9d89-2a3731e1a72a req-50b49e14-d4c0-4c96-8a6b-c076a437472c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:55.235911 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-aebcf6c6-ee7e-465b-9d89-2a3731e1a72a req-50b49e14-d4c0-4c96-8a6b-c076a437472c service nova] Creating event network-vif-deleted:224c20a8-d471-41aa-9fb6-c77acab8e577 for instance 8bbbe808-1a08-42f9-b3eb-101761f16451 on hv-cinder-74915 Oct 14 18:02:55.242767 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-aebcf6c6-ee7e-465b-9d89-2a3731e1a72a req-50b49e14-d4c0-4c96-8a6b-c076a437472c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039774 Oct 14 18:02:55.243778 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 444/877] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:02:56.114489 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:56.115098 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:56.122576 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:56.123047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:56.123476 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:56.124188 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:56.124633 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:56.125046 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:56.139078 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 HTTP/1.1 Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:02:56.140666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:02:56.142362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': '8bbbe808-1a08-42f9-b3eb-101761f16451'} Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:02:56.143572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:02:56.145148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:02:56.146499 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:02:56.146499 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-12839226-1b99-42d7-9279-e799ae170183 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 404 len: 111 microversion: 2.1 time: 0.031440 Oct 14 18:02:56.146499 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 434/878] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:56 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:02:56.153391 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2897e06c-82b0-4b81-bcfd-f1178ef9c473 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '.version_select at 0x7fe3da5c1670>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:56.172138 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2897e06c-82b0-4b81-bcfd-f1178ef9c473 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-801541812" status: 202 len: 0 microversion: 2.1 time: 0.024357 Oct 14 18:02:56.172723 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 445/879] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Oct 14 18:02:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-801541812 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:02:56.809341 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7720551b-6492-4690-a5ae-5401893a72f9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: .version_select at 0x7fe3da5d6430>, body: {"keypair": {"name": "tempest-keypair-460932029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQwSVudc3xBpnu7tRrQV6tqX6syKYiDSGhSD2GYyLMm/WWBhdpl10Rd3smxgVQA6JyN5RPySsJCbGuA2DEbEpqYQG+5Rk6IRCYNKf5HxQmNoCrPnRq21qTeiGpPqM5g1A=="}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:02:56.824506 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-7720551b-6492-4690-a5ae-5401893a72f9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:02:56.828302 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-7720551b-6492-4690-a5ae-5401893a72f9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for user 3a0657648d244f12ab76c068b38e641b and project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:02:56.850877 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7720551b-6492-4690-a5ae-5401893a72f9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045580 Oct 14 18:02:56.851504 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 435/880] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Oct 14 18:02:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:02:58.135457 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1682495552", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2dc29fa6-a064-4dfe-be69-6fc039570894"}], "security_groups": [{"name": "tempest-securitygroup--34174872"}], "key_name": "tempest-keypair-460932029", "user_data": "}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:02:58.252296 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] validate_networks() for [('2dc29fa6-a064-4dfe-be69-6fc039570894', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 18:02:58.656869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 18:02:58.657313 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 18:02:58.657773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 18:02:58.658174 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 18:02:58.658571 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 18:02:58.667191 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:58.667693 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:58.668154 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:58.668870 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:58.669313 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:58.669725 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:58.687337 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:02:58.695645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for user 3a0657648d244f12ab76c068b38e641b and project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:02:58.707776 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 18:02:58.710301 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 18:02:58.760252 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3ccf8676-b0b8-4f54-bafd-45de2b5950b0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.629522 Oct 14 18:02:58.761606 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 446/881] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 18:02:58 2022] POST /compute/v2.1/servers => generated 400 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 18:02:58.776425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2a838d73-523e-4116-9309-d0f6ba26b5b7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:58.777145 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2a838d73-523e-4116-9309-d0f6ba26b5b7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:58.834535 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2a838d73-523e-4116-9309-d0f6ba26b5b7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:58.841659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2a838d73-523e-4116-9309-d0f6ba26b5b7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1241 microversion: 2.1 time: 0.072828 Oct 14 18:02:58.842234 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 436/882] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:58 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:02:59.865496 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d2734b1c-4b56-4ef3-b46b-31ec41eda67d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:02:59.866108 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d2734b1c-4b56-4ef3-b46b-31ec41eda67d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:02:59.872489 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d2734b1c-4b56-4ef3-b46b-31ec41eda67d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:59.873027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d2734b1c-4b56-4ef3-b46b-31ec41eda67d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:59.873405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d2734b1c-4b56-4ef3-b46b-31ec41eda67d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:59.874158 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d2734b1c-4b56-4ef3-b46b-31ec41eda67d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:02:59.874611 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d2734b1c-4b56-4ef3-b46b-31ec41eda67d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:02:59.875031 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d2734b1c-4b56-4ef3-b46b-31ec41eda67d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:02:59.937323 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d2734b1c-4b56-4ef3-b46b-31ec41eda67d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:02:59.944797 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d2734b1c-4b56-4ef3-b46b-31ec41eda67d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1293 microversion: 2.1 time: 0.083761 Oct 14 18:02:59.945734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 447/883] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:02:59 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:00.968468 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2f7ba1d0-0caa-486a-9142-c7445c93fed1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:00.969077 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2f7ba1d0-0caa-486a-9142-c7445c93fed1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:00.975186 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f7ba1d0-0caa-486a-9142-c7445c93fed1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:00.975668 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f7ba1d0-0caa-486a-9142-c7445c93fed1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:00.976146 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f7ba1d0-0caa-486a-9142-c7445c93fed1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:00.976836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f7ba1d0-0caa-486a-9142-c7445c93fed1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:00.977295 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f7ba1d0-0caa-486a-9142-c7445c93fed1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:00.977769 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2f7ba1d0-0caa-486a-9142-c7445c93fed1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:01.040874 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2f7ba1d0-0caa-486a-9142-c7445c93fed1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:01.048946 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2f7ba1d0-0caa-486a-9142-c7445c93fed1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1301 microversion: 2.1 time: 0.084339 Oct 14 18:03:01.049510 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 437/884] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:00 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:02.072715 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-70adc937-62b7-4957-baa7-139890ab608b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:02.074478 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-70adc937-62b7-4957-baa7-139890ab608b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:02.077186 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:02.082824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-70adc937-62b7-4957-baa7-139890ab608b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:02.083402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-70adc937-62b7-4957-baa7-139890ab608b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:02.083951 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-70adc937-62b7-4957-baa7-139890ab608b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:02.084728 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-70adc937-62b7-4957-baa7-139890ab608b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:02.085258 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-70adc937-62b7-4957-baa7-139890ab608b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:02.085751 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-70adc937-62b7-4957-baa7-139890ab608b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:02.089851 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:02.157978 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-70adc937-62b7-4957-baa7-139890ab608b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:02.165803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-70adc937-62b7-4957-baa7-139890ab608b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1301 microversion: 2.1 time: 0.097043 Oct 14 18:03:02.166567 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 448/885] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:02 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:03.189877 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7ad1915e-72a8-4bac-85cf-504f150ff5d8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:03.190483 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7ad1915e-72a8-4bac-85cf-504f150ff5d8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:03.193837 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:03.197892 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7ad1915e-72a8-4bac-85cf-504f150ff5d8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:03.198563 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7ad1915e-72a8-4bac-85cf-504f150ff5d8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:03.198862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7ad1915e-72a8-4bac-85cf-504f150ff5d8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:03.199561 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7ad1915e-72a8-4bac-85cf-504f150ff5d8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:03.200047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7ad1915e-72a8-4bac-85cf-504f150ff5d8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:03.200468 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7ad1915e-72a8-4bac-85cf-504f150ff5d8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:03.205346 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=71 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:03.428393 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7ad1915e-72a8-4bac-85cf-504f150ff5d8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:03.436988 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7ad1915e-72a8-4bac-85cf-504f150ff5d8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.250985 Oct 14 18:03:03.437564 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 438/886] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:03 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:03:04.460075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-50791e40-02c5-45c7-9c39-f44c64e3bf2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:04.460613 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-50791e40-02c5-45c7-9c39-f44c64e3bf2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:04.467033 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50791e40-02c5-45c7-9c39-f44c64e3bf2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:04.467515 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50791e40-02c5-45c7-9c39-f44c64e3bf2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:04.468045 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50791e40-02c5-45c7-9c39-f44c64e3bf2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:04.468743 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50791e40-02c5-45c7-9c39-f44c64e3bf2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:04.469195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50791e40-02c5-45c7-9c39-f44c64e3bf2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:04.469618 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-50791e40-02c5-45c7-9c39-f44c64e3bf2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:04.597707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-50791e40-02c5-45c7-9c39-f44c64e3bf2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:04.605914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-50791e40-02c5-45c7-9c39-f44c64e3bf2b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.149818 Oct 14 18:03:04.606475 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 449/887] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:04 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:04.855595 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a7fe31ac-5a07-4fb1-b313-2ca601a64dc6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:04.856280 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a7fe31ac-5a07-4fb1-b313-2ca601a64dc6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:04.866926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7fe31ac-5a07-4fb1-b313-2ca601a64dc6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:04.866926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7fe31ac-5a07-4fb1-b313-2ca601a64dc6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:04.866926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7fe31ac-5a07-4fb1-b313-2ca601a64dc6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:04.866926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7fe31ac-5a07-4fb1-b313-2ca601a64dc6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:04.867292 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7fe31ac-5a07-4fb1-b313-2ca601a64dc6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:04.867631 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a7fe31ac-5a07-4fb1-b313-2ca601a64dc6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:04.894466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a7fe31ac-5a07-4fb1-b313-2ca601a64dc6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Going to try to terminate instance {{(pid=118656) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:03:04.968425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a7fe31ac-5a07-4fb1-b313-2ca601a64dc6 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 204 len: 0 microversion: 2.1 time: 0.119864 Oct 14 18:03:04.969008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 439/888] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:03:04 2022] DELETE /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:03:04.976959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-81c6843c-d315-4de5-8c42-cb33aafb4abe tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:04.977564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-81c6843c-d315-4de5-8c42-cb33aafb4abe tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:04.984178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81c6843c-d315-4de5-8c42-cb33aafb4abe tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:04.984661 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81c6843c-d315-4de5-8c42-cb33aafb4abe tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:04.985099 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81c6843c-d315-4de5-8c42-cb33aafb4abe tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:04.985816 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81c6843c-d315-4de5-8c42-cb33aafb4abe tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:04.986269 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81c6843c-d315-4de5-8c42-cb33aafb4abe tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:04.986689 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-81c6843c-d315-4de5-8c42-cb33aafb4abe tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:05.387342 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-81c6843c-d315-4de5-8c42-cb33aafb4abe tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:05.395075 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-81c6843c-d315-4de5-8c42-cb33aafb4abe tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1574 microversion: 2.1 time: 0.421921 Oct 14 18:03:05.395632 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 450/889] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:04 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1574 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:05.629003 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-50699829-0ff3-468a-9877-35012a558ea0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:05.629709 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-50699829-0ff3-468a-9877-35012a558ea0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:05.635757 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50699829-0ff3-468a-9877-35012a558ea0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:05.636378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50699829-0ff3-468a-9877-35012a558ea0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:05.636821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50699829-0ff3-468a-9877-35012a558ea0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:05.637523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50699829-0ff3-468a-9877-35012a558ea0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:05.637975 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50699829-0ff3-468a-9877-35012a558ea0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:05.638400 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50699829-0ff3-468a-9877-35012a558ea0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:05.764910 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-50699829-0ff3-468a-9877-35012a558ea0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:05.772387 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-50699829-0ff3-468a-9877-35012a558ea0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.147773 Oct 14 18:03:05.772944 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 440/890] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:05 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:06.418979 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-65890aff-5cf9-40b7-9ce6-9d9fa50fd35b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:06.419621 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-65890aff-5cf9-40b7-9ce6-9d9fa50fd35b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:06.425856 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65890aff-5cf9-40b7-9ce6-9d9fa50fd35b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:06.426341 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65890aff-5cf9-40b7-9ce6-9d9fa50fd35b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:06.426902 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65890aff-5cf9-40b7-9ce6-9d9fa50fd35b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:06.427838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65890aff-5cf9-40b7-9ce6-9d9fa50fd35b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:06.428568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65890aff-5cf9-40b7-9ce6-9d9fa50fd35b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:06.428993 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65890aff-5cf9-40b7-9ce6-9d9fa50fd35b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:06.650211 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-65890aff-5cf9-40b7-9ce6-9d9fa50fd35b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:06.658108 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-65890aff-5cf9-40b7-9ce6-9d9fa50fd35b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1574 microversion: 2.1 time: 0.243856 Oct 14 18:03:06.658680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 451/891] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:06 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:06.796291 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d7dc20c5-bbdc-49b2-b2d4-9d1f93d41bff tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:06.796938 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d7dc20c5-bbdc-49b2-b2d4-9d1f93d41bff tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:06.803523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7dc20c5-bbdc-49b2-b2d4-9d1f93d41bff tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:06.804078 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7dc20c5-bbdc-49b2-b2d4-9d1f93d41bff tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:06.804670 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7dc20c5-bbdc-49b2-b2d4-9d1f93d41bff tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:06.805335 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7dc20c5-bbdc-49b2-b2d4-9d1f93d41bff tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:06.805952 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7dc20c5-bbdc-49b2-b2d4-9d1f93d41bff tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:06.806429 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d7dc20c5-bbdc-49b2-b2d4-9d1f93d41bff tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:06.833384 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-56ba3ea1-cdb6-4db9-be79-91f5a2d7d2ab req-52127b1b-b4cb-44e8-b88e-6c92c53594d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f9f14d-978a-4f1a-95cf-38e34758bb00", "tag": "53884c64-df9a-4e54-bf1f-86264cf92326"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:06.843550 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-56ba3ea1-cdb6-4db9-be79-91f5a2d7d2ab req-52127b1b-b4cb-44e8-b88e-6c92c53594d6 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:06.844191 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-56ba3ea1-cdb6-4db9-be79-91f5a2d7d2ab req-52127b1b-b4cb-44e8-b88e-6c92c53594d6 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:06.844687 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-56ba3ea1-cdb6-4db9-be79-91f5a2d7d2ab req-52127b1b-b4cb-44e8-b88e-6c92c53594d6 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:06.856147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-56ba3ea1-cdb6-4db9-be79-91f5a2d7d2ab req-52127b1b-b4cb-44e8-b88e-6c92c53594d6 service nova] Creating event network-changed:53884c64-df9a-4e54-bf1f-86264cf92326 for instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 on hv-cinder-74915 Oct 14 18:03:06.861132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-56ba3ea1-cdb6-4db9-be79-91f5a2d7d2ab req-52127b1b-b4cb-44e8-b88e-6c92c53594d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031495 Oct 14 18:03:06.861718 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 452/892] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:03:06.974410 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d7dc20c5-bbdc-49b2-b2d4-9d1f93d41bff tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:06.982967 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d7dc20c5-bbdc-49b2-b2d4-9d1f93d41bff tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.191091 Oct 14 18:03:06.983529 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 441/893] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:06 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:07.681685 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5ab9461d-37d7-4b19-a8da-7e41a1e03c6d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:07.682400 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5ab9461d-37d7-4b19-a8da-7e41a1e03c6d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:07.689517 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ab9461d-37d7-4b19-a8da-7e41a1e03c6d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:07.689990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ab9461d-37d7-4b19-a8da-7e41a1e03c6d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:07.690417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ab9461d-37d7-4b19-a8da-7e41a1e03c6d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:07.691094 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ab9461d-37d7-4b19-a8da-7e41a1e03c6d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:07.691537 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ab9461d-37d7-4b19-a8da-7e41a1e03c6d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:07.691987 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5ab9461d-37d7-4b19-a8da-7e41a1e03c6d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:07.820287 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5ab9461d-37d7-4b19-a8da-7e41a1e03c6d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:07.828103 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5ab9461d-37d7-4b19-a8da-7e41a1e03c6d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1574 microversion: 2.1 time: 0.151277 Oct 14 18:03:07.828659 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 453/894] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:07 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:08.005367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-804190f3-6188-4e6b-aebb-389f088716d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:08.005994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-804190f3-6188-4e6b-aebb-389f088716d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:08.012379 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-804190f3-6188-4e6b-aebb-389f088716d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:08.012868 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-804190f3-6188-4e6b-aebb-389f088716d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:08.013306 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-804190f3-6188-4e6b-aebb-389f088716d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:08.013994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-804190f3-6188-4e6b-aebb-389f088716d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:08.014453 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-804190f3-6188-4e6b-aebb-389f088716d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:08.014877 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-804190f3-6188-4e6b-aebb-389f088716d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:08.144751 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-804190f3-6188-4e6b-aebb-389f088716d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:08.153212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-804190f3-6188-4e6b-aebb-389f088716d6 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.151771 Oct 14 18:03:08.153779 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 442/895] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:08 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:08.850859 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e29be671-b394-4886-b012-afe3d10525c0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:08.851458 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e29be671-b394-4886-b012-afe3d10525c0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:08.853461 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:08.855306 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:08.861057 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e29be671-b394-4886-b012-afe3d10525c0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:08.861534 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e29be671-b394-4886-b012-afe3d10525c0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:08.861962 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e29be671-b394-4886-b012-afe3d10525c0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:08.862647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e29be671-b394-4886-b012-afe3d10525c0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:08.863092 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e29be671-b394-4886-b012-afe3d10525c0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:08.863511 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e29be671-b394-4886-b012-afe3d10525c0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:08.993177 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e29be671-b394-4886-b012-afe3d10525c0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:09.001034 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e29be671-b394-4886-b012-afe3d10525c0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1574 microversion: 2.1 time: 0.153991 Oct 14 18:03:09.001594 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 454/896] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:08 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:09.177673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-98a38fb1-d511-4598-ba51-15178df1fbfc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:09.178544 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-98a38fb1-d511-4598-ba51-15178df1fbfc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:09.180496 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=6 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:09.186323 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98a38fb1-d511-4598-ba51-15178df1fbfc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:09.186810 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98a38fb1-d511-4598-ba51-15178df1fbfc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:09.187247 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98a38fb1-d511-4598-ba51-15178df1fbfc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:09.187966 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98a38fb1-d511-4598-ba51-15178df1fbfc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:09.188424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98a38fb1-d511-4598-ba51-15178df1fbfc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:09.188848 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-98a38fb1-d511-4598-ba51-15178df1fbfc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:09.322735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-98a38fb1-d511-4598-ba51-15178df1fbfc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:09.331247 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-98a38fb1-d511-4598-ba51-15178df1fbfc tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.157941 Oct 14 18:03:09.331833 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 443/897] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:09 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:10.026402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bf978024-6ec1-48b0-9fee-209125f6ce95 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:10.027476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bf978024-6ec1-48b0-9fee-209125f6ce95 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:10.035826 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf978024-6ec1-48b0-9fee-209125f6ce95 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:10.036512 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf978024-6ec1-48b0-9fee-209125f6ce95 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:10.037062 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf978024-6ec1-48b0-9fee-209125f6ce95 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:10.038047 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf978024-6ec1-48b0-9fee-209125f6ce95 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:10.038716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf978024-6ec1-48b0-9fee-209125f6ce95 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:10.039357 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf978024-6ec1-48b0-9fee-209125f6ce95 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:10.263451 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bf978024-6ec1-48b0-9fee-209125f6ce95 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:10.271395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bf978024-6ec1-48b0-9fee-209125f6ce95 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1574 microversion: 2.1 time: 0.249956 Oct 14 18:03:10.284370 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 455/898] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:10 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1574 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:10.356617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f2c8fb05-8b79-4772-a445-91f6510992f2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:10.357926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f2c8fb05-8b79-4772-a445-91f6510992f2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:10.368432 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2c8fb05-8b79-4772-a445-91f6510992f2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:10.370196 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2c8fb05-8b79-4772-a445-91f6510992f2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:10.370662 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2c8fb05-8b79-4772-a445-91f6510992f2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:10.371464 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2c8fb05-8b79-4772-a445-91f6510992f2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:10.372659 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2c8fb05-8b79-4772-a445-91f6510992f2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:10.373086 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f2c8fb05-8b79-4772-a445-91f6510992f2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:10.666182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f2c8fb05-8b79-4772-a445-91f6510992f2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:10.684334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f2c8fb05-8b79-4772-a445-91f6510992f2 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.327284 Oct 14 18:03:10.686056 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 444/899] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:10 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:11.249645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-e7ab2b3a-8633-4c97-9794-b142d27a8bd1 req-df2a7a6e-ac63-4491-b17f-85c7082fb25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2a9478-c81a-49f6-9176-c90b6e15466f", "name": "network-vif-deleted", "tag": "7e54b253-263a-42cf-8f31-9f4a5d1746bc"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:11.259211 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e7ab2b3a-8633-4c97-9794-b142d27a8bd1 req-df2a7a6e-ac63-4491-b17f-85c7082fb25e service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:11.259691 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e7ab2b3a-8633-4c97-9794-b142d27a8bd1 req-df2a7a6e-ac63-4491-b17f-85c7082fb25e service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:11.260145 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e7ab2b3a-8633-4c97-9794-b142d27a8bd1 req-df2a7a6e-ac63-4491-b17f-85c7082fb25e service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:11.271102 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-e7ab2b3a-8633-4c97-9794-b142d27a8bd1 req-df2a7a6e-ac63-4491-b17f-85c7082fb25e service nova] Creating event network-vif-deleted:7e54b253-263a-42cf-8f31-9f4a5d1746bc for instance fd2a9478-c81a-49f6-9176-c90b6e15466f on hv-cinder-74915 Oct 14 18:03:11.276308 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-e7ab2b3a-8633-4c97-9794-b142d27a8bd1 req-df2a7a6e-ac63-4491-b17f-85c7082fb25e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031043 Oct 14 18:03:11.277065 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 456/900] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:03:11.295032 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-af8943c3-4dc3-46ab-9035-20c6c0fa890d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:11.295641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-af8943c3-4dc3-46ab-9035-20c6c0fa890d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:11.302137 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-af8943c3-4dc3-46ab-9035-20c6c0fa890d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:11.302687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-af8943c3-4dc3-46ab-9035-20c6c0fa890d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:11.303595 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-af8943c3-4dc3-46ab-9035-20c6c0fa890d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:11.304339 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-af8943c3-4dc3-46ab-9035-20c6c0fa890d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:11.304935 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-af8943c3-4dc3-46ab-9035-20c6c0fa890d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:11.305359 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-af8943c3-4dc3-46ab-9035-20c6c0fa890d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:11.374885 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-af8943c3-4dc3-46ab-9035-20c6c0fa890d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:11.383152 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-af8943c3-4dc3-46ab-9035-20c6c0fa890d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1507 microversion: 2.1 time: 0.092465 Oct 14 18:03:11.383904 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 445/901] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:11 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1507 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:11.709467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-339fc7ea-9692-43fb-afdb-279710943613 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:11.710341 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-339fc7ea-9692-43fb-afdb-279710943613 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:11.717441 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-339fc7ea-9692-43fb-afdb-279710943613 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:11.718497 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-339fc7ea-9692-43fb-afdb-279710943613 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:11.719220 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-339fc7ea-9692-43fb-afdb-279710943613 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:11.720256 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-339fc7ea-9692-43fb-afdb-279710943613 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:11.720843 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-339fc7ea-9692-43fb-afdb-279710943613 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:11.721442 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-339fc7ea-9692-43fb-afdb-279710943613 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:11.887072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-339fc7ea-9692-43fb-afdb-279710943613 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:11.904481 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-339fc7ea-9692-43fb-afdb-279710943613 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.199014 Oct 14 18:03:11.905079 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 457/902] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:11 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:12.406623 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:12.407209 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:12.413636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:12.414124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:12.414562 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:12.415258 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:12.415714 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:12.416367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:12.456826 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:12.457604 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:12.458221 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:12.458670 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lazy-loading 'fault' on Instance uuid fd2a9478-c81a-49f6-9176-c90b6e15466f {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:03:12.506777 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:12.519249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-46cce120-b473-47bd-98b5-68540fd7517c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 200 len: 1229 microversion: 2.1 time: 0.116690 Oct 14 18:03:12.528047 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 446/903] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:12 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 1229 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:12.929694 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-efd3e98f-c8dc-4a45-aae1-36dbe8686ea8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:12.930671 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-efd3e98f-c8dc-4a45-aae1-36dbe8686ea8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:12.939081 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd3e98f-c8dc-4a45-aae1-36dbe8686ea8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:12.939682 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd3e98f-c8dc-4a45-aae1-36dbe8686ea8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:12.940348 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd3e98f-c8dc-4a45-aae1-36dbe8686ea8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:12.941933 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd3e98f-c8dc-4a45-aae1-36dbe8686ea8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:12.942580 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd3e98f-c8dc-4a45-aae1-36dbe8686ea8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:12.943011 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-efd3e98f-c8dc-4a45-aae1-36dbe8686ea8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:13.084518 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-efd3e98f-c8dc-4a45-aae1-36dbe8686ea8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:13.093599 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-efd3e98f-c8dc-4a45-aae1-36dbe8686ea8 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.168031 Oct 14 18:03:13.094562 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 458/904] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:12 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:13.546869 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:13.547932 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:13.556319 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:13.557151 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:13.558192 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:13.559997 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:13.560762 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:13.561693 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:13.579718 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] HTTP exception thrown: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Request method failure captured: Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f HTTP/1.1 Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaOZWpQaGp62BSIfkx4qhavceRUH_o-jNYVY8yp9OQSx3hBLFcCHv6IiI0NVNAn9uZnnSYjBB1eaYKelB0GnwtmzwKvipA4KmzlzM3salbGlEXZwLHIHtW-bSAmTkoUfSSZ7509FMKTfbPygcxsZkOpDnAznE4tSoZS4yhhj98XQ-po Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 87b79c338b0047dfb68e9a5b9b16c51b Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-TestVolumeBootPattern-229576454 Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:03:13.581490 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87b79c338b0047dfb68e9a5b9b16c51b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-TestVolumeBootPattern-229576454 Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 87b79c338b0047dfb68e9a5b9b16c51b Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-TestVolumeBootPattern-229576454 Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-TestVolumeBootPattern-229576454-project Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 072cedf1a6a24f6fa7d7ed92981344dd Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-TestVolumeBootPattern-229576454-project Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:03:13.583124 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'fd2a9478-c81a-49f6-9176-c90b6e15466f'} Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:03:13.584059 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:03:13.585277 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:03:13.586459 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Returning 404 to user: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:03:13.586459 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-5149322d-3715-4275-a4ef-444c70a370fd tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 404 len: 111 microversion: 2.1 time: 0.043475 Oct 14 18:03:13.588626 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 447/905] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:13 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 18:03:13.705223 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-55226599", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-941379814", "security_groups": [{"name": "tempest-secgroup-smoke-804492061"}], "block_device_mapping_v2": [{"uuid": "8f5b2109-e3ca-4d32-98f6-6e9a03711617", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "976baf89-2f42-4a40-b24d-859f3e36aec4"}]}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:13.833111 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] validate_networks() for [('976baf89-2f42-4a40-b24d-859f3e36aec4', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 18:03:14.118003 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ff92c49c-e22f-4008-9187-30e860c5910a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:14.118708 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ff92c49c-e22f-4008-9187-30e860c5910a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:14.126054 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ff92c49c-e22f-4008-9187-30e860c5910a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:14.126545 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ff92c49c-e22f-4008-9187-30e860c5910a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:14.126984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ff92c49c-e22f-4008-9187-30e860c5910a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:14.127719 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ff92c49c-e22f-4008-9187-30e860c5910a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:14.128205 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ff92c49c-e22f-4008-9187-30e860c5910a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:14.128684 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ff92c49c-e22f-4008-9187-30e860c5910a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:14.265972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 18:03:14.266474 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 18:03:14.266862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 18:03:14.267286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 18:03:14.267909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 18:03:14.276513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:14.276996 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:14.277432 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:14.278226 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:14.278675 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:14.279102 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:14.293898 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ff92c49c-e22f-4008-9187-30e860c5910a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:14.296636 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Getting quotas for project 87b79c338b0047dfb68e9a5b9b16c51b. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:03:14.300716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Getting quotas for user 072cedf1a6a24f6fa7d7ed92981344dd and project 87b79c338b0047dfb68e9a5b9b16c51b. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:03:14.301523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ff92c49c-e22f-4008-9187-30e860c5910a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.188729 Oct 14 18:03:14.302088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 448/906] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:14 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:03:14.359197 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 18:03:14.361336 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f5b2109-e3ca-4d32-98f6-6e9a03711617',volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 18:03:14.493046 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-42a37136-5291-4cf2-945e-81367f50a285 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.791951 Oct 14 18:03:14.493705 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 459/907] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 18:03:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 18:03:14.505630 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c4abbbbe-b7c3-4727-9eb0-2eed7f723255 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:14.506242 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c4abbbbe-b7c3-4727-9eb0-2eed7f723255 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:14.562362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c4abbbbe-b7c3-4727-9eb0-2eed7f723255 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:14.571318 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c4abbbbe-b7c3-4727-9eb0-2eed7f723255 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1092 microversion: 2.1 time: 0.069201 Oct 14 18:03:14.572700 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 449/908] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:14 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1092 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:15.326928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-013eef67-854f-4d42-9bbf-82e985a72b03 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:15.327534 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-013eef67-854f-4d42-9bbf-82e985a72b03 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:15.333484 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-013eef67-854f-4d42-9bbf-82e985a72b03 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:15.333954 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-013eef67-854f-4d42-9bbf-82e985a72b03 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:15.334379 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-013eef67-854f-4d42-9bbf-82e985a72b03 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:15.335053 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-013eef67-854f-4d42-9bbf-82e985a72b03 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:15.335506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-013eef67-854f-4d42-9bbf-82e985a72b03 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:15.335944 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-013eef67-854f-4d42-9bbf-82e985a72b03 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:15.468018 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-013eef67-854f-4d42-9bbf-82e985a72b03 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:15.475474 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-013eef67-854f-4d42-9bbf-82e985a72b03 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.153925 Oct 14 18:03:15.476054 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 460/909] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:15 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:15.594286 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-74892c7e-9a21-4aed-860c-4a272c47255d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:15.594896 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-74892c7e-9a21-4aed-860c-4a272c47255d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:15.601858 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-74892c7e-9a21-4aed-860c-4a272c47255d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:15.602337 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-74892c7e-9a21-4aed-860c-4a272c47255d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:15.602764 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-74892c7e-9a21-4aed-860c-4a272c47255d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:15.603444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-74892c7e-9a21-4aed-860c-4a272c47255d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:15.603909 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-74892c7e-9a21-4aed-860c-4a272c47255d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:15.604332 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-74892c7e-9a21-4aed-860c-4a272c47255d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:15.663522 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-74892c7e-9a21-4aed-860c-4a272c47255d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:15.671252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-74892c7e-9a21-4aed-860c-4a272c47255d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1134 microversion: 2.1 time: 0.080841 Oct 14 18:03:15.671754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 450/910] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:15 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1134 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:16.497709 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-63638347-c5e5-4302-83b3-aba600f7f3d4 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:16.498316 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-63638347-c5e5-4302-83b3-aba600f7f3d4 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:16.504848 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-63638347-c5e5-4302-83b3-aba600f7f3d4 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:16.505328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-63638347-c5e5-4302-83b3-aba600f7f3d4 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:16.505786 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-63638347-c5e5-4302-83b3-aba600f7f3d4 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:16.506470 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-63638347-c5e5-4302-83b3-aba600f7f3d4 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:16.506916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-63638347-c5e5-4302-83b3-aba600f7f3d4 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:16.507364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-63638347-c5e5-4302-83b3-aba600f7f3d4 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:16.639113 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-63638347-c5e5-4302-83b3-aba600f7f3d4 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:16.646821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-63638347-c5e5-4302-83b3-aba600f7f3d4 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.152978 Oct 14 18:03:16.647387 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 461/911] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:16 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:16.694565 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ddef4863-d3c0-471e-aaa9-81f67344d3ce tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:16.695164 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ddef4863-d3c0-471e-aaa9-81f67344d3ce tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:16.702498 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ddef4863-d3c0-471e-aaa9-81f67344d3ce tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:16.702978 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ddef4863-d3c0-471e-aaa9-81f67344d3ce tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:16.703406 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ddef4863-d3c0-471e-aaa9-81f67344d3ce tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:16.704122 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ddef4863-d3c0-471e-aaa9-81f67344d3ce tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:16.704575 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ddef4863-d3c0-471e-aaa9-81f67344d3ce tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:16.704992 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ddef4863-d3c0-471e-aaa9-81f67344d3ce tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:16.765105 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ddef4863-d3c0-471e-aaa9-81f67344d3ce tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:16.772652 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ddef4863-d3c0-471e-aaa9-81f67344d3ce tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1134 microversion: 2.1 time: 0.082071 Oct 14 18:03:16.773215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 451/912] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:16 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1134 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:17.670787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c6a26485-c567-4343-8f05-3dab80c5a40b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:17.671333 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c6a26485-c567-4343-8f05-3dab80c5a40b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:17.677715 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6a26485-c567-4343-8f05-3dab80c5a40b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:17.678195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6a26485-c567-4343-8f05-3dab80c5a40b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:17.678883 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6a26485-c567-4343-8f05-3dab80c5a40b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:17.679570 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6a26485-c567-4343-8f05-3dab80c5a40b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:17.680058 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6a26485-c567-4343-8f05-3dab80c5a40b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:17.680477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c6a26485-c567-4343-8f05-3dab80c5a40b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:17.796371 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-77a42b28-6e75-41b7-ae58-93b9b4639c5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:17.797652 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-77a42b28-6e75-41b7-ae58-93b9b4639c5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:17.805326 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-77a42b28-6e75-41b7-ae58-93b9b4639c5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:17.805937 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-77a42b28-6e75-41b7-ae58-93b9b4639c5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:17.806662 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-77a42b28-6e75-41b7-ae58-93b9b4639c5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:17.807649 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-77a42b28-6e75-41b7-ae58-93b9b4639c5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:17.808152 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-77a42b28-6e75-41b7-ae58-93b9b4639c5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:17.808670 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-77a42b28-6e75-41b7-ae58-93b9b4639c5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:17.812864 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c6a26485-c567-4343-8f05-3dab80c5a40b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:17.822551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c6a26485-c567-4343-8f05-3dab80c5a40b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.156119 Oct 14 18:03:17.835941 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 462/913] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:17 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:17.873844 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-77a42b28-6e75-41b7-ae58-93b9b4639c5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:17.881597 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-77a42b28-6e75-41b7-ae58-93b9b4639c5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1190 microversion: 2.1 time: 0.090137 Oct 14 18:03:17.882156 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 452/914] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:17 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1190 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:03:18.225362 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-28c62711-44b0-4b89-8abe-313fea35a058 req-5017083f-1691-489a-813f-b61129080c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f9f14d-978a-4f1a-95cf-38e34758bb00", "name": "network-vif-plugged", "status": "completed", "tag": "53884c64-df9a-4e54-bf1f-86264cf92326"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:18.236325 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-28c62711-44b0-4b89-8abe-313fea35a058 req-5017083f-1691-489a-813f-b61129080c95 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:18.237372 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-28c62711-44b0-4b89-8abe-313fea35a058 req-5017083f-1691-489a-813f-b61129080c95 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:18.237807 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-28c62711-44b0-4b89-8abe-313fea35a058 req-5017083f-1691-489a-813f-b61129080c95 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:18.249142 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-28c62711-44b0-4b89-8abe-313fea35a058 req-5017083f-1691-489a-813f-b61129080c95 service nova] Creating event network-vif-plugged:53884c64-df9a-4e54-bf1f-86264cf92326 for instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 on hv-cinder-74915 Oct 14 18:03:18.253922 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-28c62711-44b0-4b89-8abe-313fea35a058 req-5017083f-1691-489a-813f-b61129080c95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032322 Oct 14 18:03:18.254516 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 463/915] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:03:18.845567 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ada7176b-aa5f-4961-9210-1747bfeb8d67 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:18.846181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ada7176b-aa5f-4961-9210-1747bfeb8d67 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:18.852623 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ada7176b-aa5f-4961-9210-1747bfeb8d67 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:18.853103 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ada7176b-aa5f-4961-9210-1747bfeb8d67 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:18.853540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ada7176b-aa5f-4961-9210-1747bfeb8d67 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:18.854230 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ada7176b-aa5f-4961-9210-1747bfeb8d67 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:18.854691 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ada7176b-aa5f-4961-9210-1747bfeb8d67 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:18.855114 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ada7176b-aa5f-4961-9210-1747bfeb8d67 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:18.905691 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-18995d22-4f5d-4b4b-ad50-bb1e489f2cc7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:18.906490 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-18995d22-4f5d-4b4b-ad50-bb1e489f2cc7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:18.914514 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-18995d22-4f5d-4b4b-ad50-bb1e489f2cc7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:18.915112 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-18995d22-4f5d-4b4b-ad50-bb1e489f2cc7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:18.916385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-18995d22-4f5d-4b4b-ad50-bb1e489f2cc7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:18.917105 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-18995d22-4f5d-4b4b-ad50-bb1e489f2cc7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:18.917658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-18995d22-4f5d-4b4b-ad50-bb1e489f2cc7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:18.919927 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-18995d22-4f5d-4b4b-ad50-bb1e489f2cc7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:19.034201 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-18995d22-4f5d-4b4b-ad50-bb1e489f2cc7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:19.041045 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ada7176b-aa5f-4961-9210-1747bfeb8d67 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:19.047304 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-18995d22-4f5d-4b4b-ad50-bb1e489f2cc7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1208 microversion: 2.1 time: 0.145728 Oct 14 18:03:19.049764 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ada7176b-aa5f-4961-9210-1747bfeb8d67 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.207987 Oct 14 18:03:19.050342 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 453/916] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:18 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:19.057593 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 464/917] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:18 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1208 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:03:20.072666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3679eba5-8d04-4469-bc74-c3adfc8384a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:20.073865 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3679eba5-8d04-4469-bc74-c3adfc8384a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:20.074230 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bcb9c8b7-58c4-409a-b176-937badff0b35 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:20.074871 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bcb9c8b7-58c4-409a-b176-937badff0b35 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:20.081629 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3679eba5-8d04-4469-bc74-c3adfc8384a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:20.082364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3679eba5-8d04-4469-bc74-c3adfc8384a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:20.082504 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcb9c8b7-58c4-409a-b176-937badff0b35 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:20.082869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcb9c8b7-58c4-409a-b176-937badff0b35 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:20.083253 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3679eba5-8d04-4469-bc74-c3adfc8384a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:20.083393 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcb9c8b7-58c4-409a-b176-937badff0b35 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:20.084027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcb9c8b7-58c4-409a-b176-937badff0b35 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:20.084474 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcb9c8b7-58c4-409a-b176-937badff0b35 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:20.084631 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3679eba5-8d04-4469-bc74-c3adfc8384a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:20.084887 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcb9c8b7-58c4-409a-b176-937badff0b35 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:20.085414 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3679eba5-8d04-4469-bc74-c3adfc8384a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:20.085839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3679eba5-8d04-4469-bc74-c3adfc8384a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:20.101913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:20.300944 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bcb9c8b7-58c4-409a-b176-937badff0b35 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:20.309071 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bcb9c8b7-58c4-409a-b176-937badff0b35 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1365 microversion: 2.1 time: 0.238361 Oct 14 18:03:20.316513 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3679eba5-8d04-4469-bc74-c3adfc8384a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:20.317768 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 465/918] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:20 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:03:20.322886 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-ea371b13-8c9a-442c-8ece-836de1f1bbb9 req-bd2e6cf3-740f-4b48-9555-95c5098a04c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2088de31-2372-410a-8cdf-aa5c6994b8e1", "tag": "0b6dee5f-1229-4749-9587-2fc70c8030a4"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:20.324885 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3679eba5-8d04-4469-bc74-c3adfc8384a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1263 microversion: 2.1 time: 0.256193 Oct 14 18:03:20.326800 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 454/919] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:20 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1263 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:03:20.334333 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-ea371b13-8c9a-442c-8ece-836de1f1bbb9 req-bd2e6cf3-740f-4b48-9555-95c5098a04c1 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:20.334926 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-ea371b13-8c9a-442c-8ece-836de1f1bbb9 req-bd2e6cf3-740f-4b48-9555-95c5098a04c1 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:20.335448 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-ea371b13-8c9a-442c-8ece-836de1f1bbb9 req-bd2e6cf3-740f-4b48-9555-95c5098a04c1 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:20.346535 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-ea371b13-8c9a-442c-8ece-836de1f1bbb9 req-bd2e6cf3-740f-4b48-9555-95c5098a04c1 service nova] Creating event network-changed:0b6dee5f-1229-4749-9587-2fc70c8030a4 for instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 on hv-cinder-74915 Oct 14 18:03:20.352055 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-ea371b13-8c9a-442c-8ece-836de1f1bbb9 req-bd2e6cf3-740f-4b48-9555-95c5098a04c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032428 Oct 14 18:03:20.352228 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 466/920] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:03:21.333012 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-52c82f24-0ebf-4474-a387-f0ec46540d73 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:21.333616 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-52c82f24-0ebf-4474-a387-f0ec46540d73 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:21.340225 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c82f24-0ebf-4474-a387-f0ec46540d73 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:21.341423 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c82f24-0ebf-4474-a387-f0ec46540d73 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:21.341863 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c82f24-0ebf-4474-a387-f0ec46540d73 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:21.342553 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c82f24-0ebf-4474-a387-f0ec46540d73 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:21.343004 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c82f24-0ebf-4474-a387-f0ec46540d73 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:21.343421 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-52c82f24-0ebf-4474-a387-f0ec46540d73 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:21.351847 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-0f0e2318-0228-46e3-b9a8-52816508ee7a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:21.353126 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-0f0e2318-0228-46e3-b9a8-52816508ee7a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:21.361165 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0f0e2318-0228-46e3-b9a8-52816508ee7a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:21.361904 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0f0e2318-0228-46e3-b9a8-52816508ee7a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:21.363082 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0f0e2318-0228-46e3-b9a8-52816508ee7a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:21.363980 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0f0e2318-0228-46e3-b9a8-52816508ee7a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:21.364593 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0f0e2318-0228-46e3-b9a8-52816508ee7a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:21.365176 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-0f0e2318-0228-46e3-b9a8-52816508ee7a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:21.542678 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-52c82f24-0ebf-4474-a387-f0ec46540d73 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:21.550801 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-52c82f24-0ebf-4474-a387-f0ec46540d73 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1556 microversion: 2.1 time: 0.221712 Oct 14 18:03:21.551463 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 455/921] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:21 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1556 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:03:21.556258 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-0f0e2318-0228-46e3-b9a8-52816508ee7a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:21.564881 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-0f0e2318-0228-46e3-b9a8-52816508ee7a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1263 microversion: 2.1 time: 0.219809 Oct 14 18:03:21.565438 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 467/922] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:21 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1263 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:21.573402 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-80d6755b-0cb9-4a6a-b67d-516c6914506f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:21.573889 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-80d6755b-0cb9-4a6a-b67d-516c6914506f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:21.580879 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d6755b-0cb9-4a6a-b67d-516c6914506f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:21.581350 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d6755b-0cb9-4a6a-b67d-516c6914506f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:21.581774 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d6755b-0cb9-4a6a-b67d-516c6914506f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:21.582452 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d6755b-0cb9-4a6a-b67d-516c6914506f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:21.582900 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d6755b-0cb9-4a6a-b67d-516c6914506f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:21.583317 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-80d6755b-0cb9-4a6a-b67d-516c6914506f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:21.665216 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-80d6755b-0cb9-4a6a-b67d-516c6914506f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095623 Oct 14 18:03:21.665805 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 456/923] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Oct 14 18:03:21 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:03:22.589375 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ebe41c9a-02d0-41cb-9181-a712f957a1c4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:22.591554 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ebe41c9a-02d0-41cb-9181-a712f957a1c4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:22.600598 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebe41c9a-02d0-41cb-9181-a712f957a1c4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:22.601192 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebe41c9a-02d0-41cb-9181-a712f957a1c4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:22.601898 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebe41c9a-02d0-41cb-9181-a712f957a1c4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:22.602880 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebe41c9a-02d0-41cb-9181-a712f957a1c4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:22.603443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebe41c9a-02d0-41cb-9181-a712f957a1c4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:22.603959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebe41c9a-02d0-41cb-9181-a712f957a1c4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:22.609455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=100 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:22.707008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-5458f1e9-94d4-460e-8091-9319fc8277bb req-68057e03-155b-4064-9c53-5876c6037268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f9f14d-978a-4f1a-95cf-38e34758bb00", "tag": "53884c64-df9a-4e54-bf1f-86264cf92326"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:22.724850 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-5458f1e9-94d4-460e-8091-9319fc8277bb req-68057e03-155b-4064-9c53-5876c6037268 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:22.725635 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-5458f1e9-94d4-460e-8091-9319fc8277bb req-68057e03-155b-4064-9c53-5876c6037268 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:22.726263 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-5458f1e9-94d4-460e-8091-9319fc8277bb req-68057e03-155b-4064-9c53-5876c6037268 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:22.740134 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-5458f1e9-94d4-460e-8091-9319fc8277bb req-68057e03-155b-4064-9c53-5876c6037268 service nova] Creating event network-changed:53884c64-df9a-4e54-bf1f-86264cf92326 for instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 on hv-cinder-74915 Oct 14 18:03:22.747115 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-5458f1e9-94d4-460e-8091-9319fc8277bb req-68057e03-155b-4064-9c53-5876c6037268 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044280 Oct 14 18:03:22.747840 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 457/924] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:03:22.778910 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ebe41c9a-02d0-41cb-9181-a712f957a1c4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:22.787266 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ebe41c9a-02d0-41cb-9181-a712f957a1c4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1263 microversion: 2.1 time: 0.202786 Oct 14 18:03:22.788215 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 468/925] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:22 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1263 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:23.816546 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-886e4342-df9d-4414-83df-1f193ff417ae tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:23.817328 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-886e4342-df9d-4414-83df-1f193ff417ae tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:23.823896 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-886e4342-df9d-4414-83df-1f193ff417ae tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:23.824432 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-886e4342-df9d-4414-83df-1f193ff417ae tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:23.824940 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-886e4342-df9d-4414-83df-1f193ff417ae tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:23.825642 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-886e4342-df9d-4414-83df-1f193ff417ae tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:23.826096 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-886e4342-df9d-4414-83df-1f193ff417ae tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:23.826519 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-886e4342-df9d-4414-83df-1f193ff417ae tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:23.961507 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-886e4342-df9d-4414-83df-1f193ff417ae tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:23.970721 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-886e4342-df9d-4414-83df-1f193ff417ae tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1263 microversion: 2.1 time: 0.163565 Oct 14 18:03:23.971293 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 458/926] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:23 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:24.996021 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-87ecee45-ab02-4f95-96f3-e432651101cc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:24.996714 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-87ecee45-ab02-4f95-96f3-e432651101cc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:25.000468 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:25.001108 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:25.005820 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-87ecee45-ab02-4f95-96f3-e432651101cc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:25.006293 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-87ecee45-ab02-4f95-96f3-e432651101cc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:25.006791 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-87ecee45-ab02-4f95-96f3-e432651101cc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:25.007642 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-87ecee45-ab02-4f95-96f3-e432651101cc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:25.008213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-87ecee45-ab02-4f95-96f3-e432651101cc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:25.008670 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-87ecee45-ab02-4f95-96f3-e432651101cc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:25.158212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-87ecee45-ab02-4f95-96f3-e432651101cc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:25.166066 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-87ecee45-ab02-4f95-96f3-e432651101cc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1263 microversion: 2.1 time: 0.173983 Oct 14 18:03:25.166627 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 469/927] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:24 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:26.190072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-15e87a13-33df-47c1-922d-a5446031bdf5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:26.190881 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-15e87a13-33df-47c1-922d-a5446031bdf5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:26.193964 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:26.198589 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15e87a13-33df-47c1-922d-a5446031bdf5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:26.199221 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15e87a13-33df-47c1-922d-a5446031bdf5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:26.199667 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15e87a13-33df-47c1-922d-a5446031bdf5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:26.200475 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15e87a13-33df-47c1-922d-a5446031bdf5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:26.201198 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15e87a13-33df-47c1-922d-a5446031bdf5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:26.201692 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-15e87a13-33df-47c1-922d-a5446031bdf5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:26.337829 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-15e87a13-33df-47c1-922d-a5446031bdf5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:26.347442 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-15e87a13-33df-47c1-922d-a5446031bdf5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1263 microversion: 2.1 time: 0.161132 Oct 14 18:03:26.348230 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 459/928] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:26 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:27.370646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-1c512616-d5fe-4cf4-b116-14d709139094 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:27.371264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-1c512616-d5fe-4cf4-b116-14d709139094 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:27.378576 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1c512616-d5fe-4cf4-b116-14d709139094 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:27.379061 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1c512616-d5fe-4cf4-b116-14d709139094 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:27.379491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1c512616-d5fe-4cf4-b116-14d709139094 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:27.380210 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1c512616-d5fe-4cf4-b116-14d709139094 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:27.380657 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1c512616-d5fe-4cf4-b116-14d709139094 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:27.381072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1c512616-d5fe-4cf4-b116-14d709139094 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:27.516359 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1c512616-d5fe-4cf4-b116-14d709139094 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:27.524012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-1c512616-d5fe-4cf4-b116-14d709139094 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1263 microversion: 2.1 time: 0.157241 Oct 14 18:03:27.524585 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 470/929] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:27 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:28.546622 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3d7d401a-e38a-4f8f-a0d0-e475fcc19dc4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:28.547319 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3d7d401a-e38a-4f8f-a0d0-e475fcc19dc4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:28.554031 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d7d401a-e38a-4f8f-a0d0-e475fcc19dc4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:28.554948 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d7d401a-e38a-4f8f-a0d0-e475fcc19dc4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:28.555449 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d7d401a-e38a-4f8f-a0d0-e475fcc19dc4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:28.556787 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d7d401a-e38a-4f8f-a0d0-e475fcc19dc4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:28.557236 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d7d401a-e38a-4f8f-a0d0-e475fcc19dc4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:28.557835 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3d7d401a-e38a-4f8f-a0d0-e475fcc19dc4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:28.994785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3d7d401a-e38a-4f8f-a0d0-e475fcc19dc4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:29.003393 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3d7d401a-e38a-4f8f-a0d0-e475fcc19dc4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1263 microversion: 2.1 time: 0.460815 Oct 14 18:03:29.004138 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 460/930] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:28 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1263 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:30.026167 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4c04ee9b-7680-4d66-919e-ba04f0af7be4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:30.026792 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4c04ee9b-7680-4d66-919e-ba04f0af7be4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:30.033382 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c04ee9b-7680-4d66-919e-ba04f0af7be4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:30.033868 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c04ee9b-7680-4d66-919e-ba04f0af7be4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:30.034295 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c04ee9b-7680-4d66-919e-ba04f0af7be4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:30.034986 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c04ee9b-7680-4d66-919e-ba04f0af7be4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:30.035434 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c04ee9b-7680-4d66-919e-ba04f0af7be4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:30.035863 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c04ee9b-7680-4d66-919e-ba04f0af7be4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:30.198594 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4c04ee9b-7680-4d66-919e-ba04f0af7be4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:30.208229 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4c04ee9b-7680-4d66-919e-ba04f0af7be4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1263 microversion: 2.1 time: 0.185829 Oct 14 18:03:30.208984 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 471/931] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:30 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1263 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:30.306747 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-ea3d920b-6af0-44f3-b6e3-cb07c905d5f5 req-bcb42d17-c1b2-48ba-8b15-f578dc3319b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2088de31-2372-410a-8cdf-aa5c6994b8e1", "name": "network-vif-plugged", "status": "completed", "tag": "0b6dee5f-1229-4749-9587-2fc70c8030a4"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:30.319836 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-ea3d920b-6af0-44f3-b6e3-cb07c905d5f5 req-bcb42d17-c1b2-48ba-8b15-f578dc3319b6 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:30.320353 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-ea3d920b-6af0-44f3-b6e3-cb07c905d5f5 req-bcb42d17-c1b2-48ba-8b15-f578dc3319b6 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:30.320785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-ea3d920b-6af0-44f3-b6e3-cb07c905d5f5 req-bcb42d17-c1b2-48ba-8b15-f578dc3319b6 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:30.336114 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-ea3d920b-6af0-44f3-b6e3-cb07c905d5f5 req-bcb42d17-c1b2-48ba-8b15-f578dc3319b6 service nova] Creating event network-vif-plugged:0b6dee5f-1229-4749-9587-2fc70c8030a4 for instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 on hv-cinder-74915 Oct 14 18:03:30.344148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-ea3d920b-6af0-44f3-b6e3-cb07c905d5f5 req-bcb42d17-c1b2-48ba-8b15-f578dc3319b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039439 Oct 14 18:03:30.344148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 461/932] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:03:31.234903 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-52287e86-a9d6-4d4f-8be5-4c3cd2017f8c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:31.235529 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-52287e86-a9d6-4d4f-8be5-4c3cd2017f8c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:31.241890 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52287e86-a9d6-4d4f-8be5-4c3cd2017f8c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:31.242400 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52287e86-a9d6-4d4f-8be5-4c3cd2017f8c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:31.242826 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52287e86-a9d6-4d4f-8be5-4c3cd2017f8c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:31.243507 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52287e86-a9d6-4d4f-8be5-4c3cd2017f8c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:31.243980 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52287e86-a9d6-4d4f-8be5-4c3cd2017f8c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:31.244430 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-52287e86-a9d6-4d4f-8be5-4c3cd2017f8c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:31.392981 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-52287e86-a9d6-4d4f-8be5-4c3cd2017f8c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:31.400613 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-52287e86-a9d6-4d4f-8be5-4c3cd2017f8c tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1263 microversion: 2.1 time: 0.170866 Oct 14 18:03:31.401167 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 472/933] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:31 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:32.423230 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-06f9a990-f1ae-40cf-aff2-5ed41a46313b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:32.423954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-06f9a990-f1ae-40cf-aff2-5ed41a46313b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:32.430846 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06f9a990-f1ae-40cf-aff2-5ed41a46313b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:32.431397 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06f9a990-f1ae-40cf-aff2-5ed41a46313b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:32.431835 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06f9a990-f1ae-40cf-aff2-5ed41a46313b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:32.432555 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06f9a990-f1ae-40cf-aff2-5ed41a46313b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:32.433013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06f9a990-f1ae-40cf-aff2-5ed41a46313b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:32.433436 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-06f9a990-f1ae-40cf-aff2-5ed41a46313b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:32.569775 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-06f9a990-f1ae-40cf-aff2-5ed41a46313b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:32.578524 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-06f9a990-f1ae-40cf-aff2-5ed41a46313b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1450 microversion: 2.1 time: 0.159653 Oct 14 18:03:32.579098 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 462/934] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:32 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:32.601136 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e1542502-63d2-463e-93f2-dbe508cf9777 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:32.601752 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e1542502-63d2-463e-93f2-dbe508cf9777 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:32.604033 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:32.610503 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e1542502-63d2-463e-93f2-dbe508cf9777 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:32.611417 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e1542502-63d2-463e-93f2-dbe508cf9777 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:32.611838 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e1542502-63d2-463e-93f2-dbe508cf9777 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:32.612581 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e1542502-63d2-463e-93f2-dbe508cf9777 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:32.613396 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e1542502-63d2-463e-93f2-dbe508cf9777 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:32.613816 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e1542502-63d2-463e-93f2-dbe508cf9777 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:32.755477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e1542502-63d2-463e-93f2-dbe508cf9777 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:32.764812 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e1542502-63d2-463e-93f2-dbe508cf9777 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1450 microversion: 2.1 time: 0.167397 Oct 14 18:03:32.765488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 473/935] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:32 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:34.636136 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-f3e05df0-8de0-449c-bed6-9b59d6709d76 req-ee260b67-51d9-4a21-b36e-d76a3dbd5f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2088de31-2372-410a-8cdf-aa5c6994b8e1", "tag": "0b6dee5f-1229-4749-9587-2fc70c8030a4"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:34.643229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:34.648711 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-f3e05df0-8de0-449c-bed6-9b59d6709d76 req-ee260b67-51d9-4a21-b36e-d76a3dbd5f93 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:34.649119 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-f3e05df0-8de0-449c-bed6-9b59d6709d76 req-ee260b67-51d9-4a21-b36e-d76a3dbd5f93 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:34.649545 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-f3e05df0-8de0-449c-bed6-9b59d6709d76 req-ee260b67-51d9-4a21-b36e-d76a3dbd5f93 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:34.662745 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-f3e05df0-8de0-449c-bed6-9b59d6709d76 req-ee260b67-51d9-4a21-b36e-d76a3dbd5f93 service nova] Creating event network-changed:0b6dee5f-1229-4749-9587-2fc70c8030a4 for instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 on hv-cinder-74915 Oct 14 18:03:34.668526 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-f3e05df0-8de0-449c-bed6-9b59d6709d76 req-ee260b67-51d9-4a21-b36e-d76a3dbd5f93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035963 Oct 14 18:03:34.673622 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 463/936] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:03:41.871923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-524045854", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "networks": [{"uuid": "52d83ba1-6fb0-435a-a3bb-555ed9736066"}]}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:41.925175 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] validate_networks() for [('52d83ba1-6fb0-435a-a3bb-555ed9736066', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 18:03:42.271218 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 18:03:42.271632 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 18:03:42.272152 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 18:03:42.272553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 18:03:42.272952 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 18:03:42.282119 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:42.282586 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:42.283007 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:42.283745 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:42.284219 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:42.284635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:42.300589 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Getting quotas for project b0b92ab9577946a3af15e4698bd5b1e9. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:03:42.304513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Getting quotas for user 20b39293079c4ec68aa1482bc7adee96 and project b0b92ab9577946a3af15e4698bd5b1e9. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:03:42.315431 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 18:03:42.317663 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 18:03:42.363136 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7af82f6a-d1fd-43b7-bee7-3832973a34f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494928 Oct 14 18:03:42.363968 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 474/937] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 18:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 18:03:42.376870 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-826c9c51-326b-4afa-9a8b-626e0173ab76 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:42.377693 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-826c9c51-326b-4afa-9a8b-626e0173ab76 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:42.435371 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-826c9c51-326b-4afa-9a8b-626e0173ab76 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:42.443042 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-826c9c51-326b-4afa-9a8b-626e0173ab76 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1213 microversion: 2.1 time: 0.072002 Oct 14 18:03:42.443785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 464/938] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:42 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:43.465903 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a1c4475b-c933-40b5-9117-3b881c6dc7e6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:43.466619 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a1c4475b-c933-40b5-9117-3b881c6dc7e6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:43.474922 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1c4475b-c933-40b5-9117-3b881c6dc7e6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:43.475406 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1c4475b-c933-40b5-9117-3b881c6dc7e6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:43.475832 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1c4475b-c933-40b5-9117-3b881c6dc7e6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:43.476554 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1c4475b-c933-40b5-9117-3b881c6dc7e6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:43.477000 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1c4475b-c933-40b5-9117-3b881c6dc7e6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:43.477413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a1c4475b-c933-40b5-9117-3b881c6dc7e6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:43.544665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a1c4475b-c933-40b5-9117-3b881c6dc7e6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:43.553270 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a1c4475b-c933-40b5-9117-3b881c6dc7e6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1273 microversion: 2.1 time: 0.091274 Oct 14 18:03:43.553963 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 475/939] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:43 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:44.578633 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e7f299de-ce9b-4bf7-9867-755fda704cc7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:44.579332 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e7f299de-ce9b-4bf7-9867-755fda704cc7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:44.587769 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7f299de-ce9b-4bf7-9867-755fda704cc7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:44.589153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7f299de-ce9b-4bf7-9867-755fda704cc7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:44.589825 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7f299de-ce9b-4bf7-9867-755fda704cc7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:44.590715 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7f299de-ce9b-4bf7-9867-755fda704cc7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:44.591529 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7f299de-ce9b-4bf7-9867-755fda704cc7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:44.592793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7f299de-ce9b-4bf7-9867-755fda704cc7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:44.726762 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e7f299de-ce9b-4bf7-9867-755fda704cc7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:44.735206 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e7f299de-ce9b-4bf7-9867-755fda704cc7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1313 microversion: 2.1 time: 0.161402 Oct 14 18:03:44.735785 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 465/940] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:44 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:44.790217 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-956b4b7e-2f19-48b8-ae21-d26665702d06 req-ca6219a5-24dd-4727-9343-bad9c99673c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29bdf311-5c5c-4787-8f25-074b7cea4e7f", "tag": "4a5ee872-76d4-4a98-bcc3-f7c71d3167f7"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:44.801460 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-956b4b7e-2f19-48b8-ae21-d26665702d06 req-ca6219a5-24dd-4727-9343-bad9c99673c9 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:44.801966 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-956b4b7e-2f19-48b8-ae21-d26665702d06 req-ca6219a5-24dd-4727-9343-bad9c99673c9 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:44.802401 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-956b4b7e-2f19-48b8-ae21-d26665702d06 req-ca6219a5-24dd-4727-9343-bad9c99673c9 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:44.814205 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-956b4b7e-2f19-48b8-ae21-d26665702d06 req-ca6219a5-24dd-4727-9343-bad9c99673c9 service nova] Creating event network-changed:4a5ee872-76d4-4a98-bcc3-f7c71d3167f7 for instance 29bdf311-5c5c-4787-8f25-074b7cea4e7f on hv-cinder-74915 Oct 14 18:03:44.819112 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-956b4b7e-2f19-48b8-ae21-d26665702d06 req-ca6219a5-24dd-4727-9343-bad9c99673c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032612 Oct 14 18:03:44.819857 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 476/941] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:03:45.756995 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-088f090b-3dd4-46dd-bb4a-ee2dca5d4f93 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:45.757610 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-088f090b-3dd4-46dd-bb4a-ee2dca5d4f93 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:45.764793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-088f090b-3dd4-46dd-bb4a-ee2dca5d4f93 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:45.764793 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-088f090b-3dd4-46dd-bb4a-ee2dca5d4f93 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:45.765089 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-088f090b-3dd4-46dd-bb4a-ee2dca5d4f93 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:45.765787 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-088f090b-3dd4-46dd-bb4a-ee2dca5d4f93 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:45.766241 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-088f090b-3dd4-46dd-bb4a-ee2dca5d4f93 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:45.766661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-088f090b-3dd4-46dd-bb4a-ee2dca5d4f93 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:45.899483 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-088f090b-3dd4-46dd-bb4a-ee2dca5d4f93 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:45.907069 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-088f090b-3dd4-46dd-bb4a-ee2dca5d4f93 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1313 microversion: 2.1 time: 0.153919 Oct 14 18:03:45.907634 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 466/942] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:45 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:46.931856 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b94c3e77-0ae2-4150-b3c2-0c247463856f tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:46.932516 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b94c3e77-0ae2-4150-b3c2-0c247463856f tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:46.938577 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b94c3e77-0ae2-4150-b3c2-0c247463856f tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:46.939052 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b94c3e77-0ae2-4150-b3c2-0c247463856f tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:46.939482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b94c3e77-0ae2-4150-b3c2-0c247463856f tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:46.940195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b94c3e77-0ae2-4150-b3c2-0c247463856f tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:46.940644 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b94c3e77-0ae2-4150-b3c2-0c247463856f tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:46.941063 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b94c3e77-0ae2-4150-b3c2-0c247463856f tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:47.068522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b94c3e77-0ae2-4150-b3c2-0c247463856f tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:47.076062 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b94c3e77-0ae2-4150-b3c2-0c247463856f tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1313 microversion: 2.1 time: 0.149058 Oct 14 18:03:47.076639 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 477/943] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:46 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:48.102088 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-45394e01-e214-4255-a2b7-e77e9977edff tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:48.102687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-45394e01-e214-4255-a2b7-e77e9977edff tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:48.110053 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45394e01-e214-4255-a2b7-e77e9977edff tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:48.110557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45394e01-e214-4255-a2b7-e77e9977edff tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:48.110986 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45394e01-e214-4255-a2b7-e77e9977edff tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:48.111667 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45394e01-e214-4255-a2b7-e77e9977edff tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:48.112169 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45394e01-e214-4255-a2b7-e77e9977edff tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:48.112587 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-45394e01-e214-4255-a2b7-e77e9977edff tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:48.244505 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-45394e01-e214-4255-a2b7-e77e9977edff tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:48.253096 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-45394e01-e214-4255-a2b7-e77e9977edff tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1313 microversion: 2.1 time: 0.154835 Oct 14 18:03:48.253855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 467/944] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:48 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:48.378677 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-4a646725-0ffb-4499-bd74-3f16fed0f244 req-00feabe2-5a5c-40e5-ba5f-99e147029578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bdf311-5c5c-4787-8f25-074b7cea4e7f", "name": "network-vif-plugged", "status": "completed", "tag": "4a5ee872-76d4-4a98-bcc3-f7c71d3167f7"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:48.388803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-4a646725-0ffb-4499-bd74-3f16fed0f244 req-00feabe2-5a5c-40e5-ba5f-99e147029578 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:48.389303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-4a646725-0ffb-4499-bd74-3f16fed0f244 req-00feabe2-5a5c-40e5-ba5f-99e147029578 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:48.389736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-4a646725-0ffb-4499-bd74-3f16fed0f244 req-00feabe2-5a5c-40e5-ba5f-99e147029578 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:48.401019 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-4a646725-0ffb-4499-bd74-3f16fed0f244 req-00feabe2-5a5c-40e5-ba5f-99e147029578 service nova] Creating event network-vif-plugged:4a5ee872-76d4-4a98-bcc3-f7c71d3167f7 for instance 29bdf311-5c5c-4787-8f25-074b7cea4e7f on hv-cinder-74915 Oct 14 18:03:48.406179 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-4a646725-0ffb-4499-bd74-3f16fed0f244 req-00feabe2-5a5c-40e5-ba5f-99e147029578 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031161 Oct 14 18:03:48.406797 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 478/945] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:03:49.275810 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bc54f75e-652d-4b70-a4b1-f7f87cb6ea53 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:49.276438 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-bc54f75e-652d-4b70-a4b1-f7f87cb6ea53 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:49.283355 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc54f75e-652d-4b70-a4b1-f7f87cb6ea53 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:49.283834 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc54f75e-652d-4b70-a4b1-f7f87cb6ea53 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:49.284292 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc54f75e-652d-4b70-a4b1-f7f87cb6ea53 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:49.284984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc54f75e-652d-4b70-a4b1-f7f87cb6ea53 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:49.285437 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc54f75e-652d-4b70-a4b1-f7f87cb6ea53 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:49.285860 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bc54f75e-652d-4b70-a4b1-f7f87cb6ea53 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:49.421436 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-bc54f75e-652d-4b70-a4b1-f7f87cb6ea53 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:49.428954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-bc54f75e-652d-4b70-a4b1-f7f87cb6ea53 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1313 microversion: 2.1 time: 0.156996 Oct 14 18:03:49.429517 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 468/946] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:49 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:49.855350 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b3c9c7db-5d27-495a-8362-d02c22b774fd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:49.855988 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b3c9c7db-5d27-495a-8362-d02c22b774fd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:49.862761 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7db-5d27-495a-8362-d02c22b774fd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:49.863243 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7db-5d27-495a-8362-d02c22b774fd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:49.863697 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7db-5d27-495a-8362-d02c22b774fd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:49.864410 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7db-5d27-495a-8362-d02c22b774fd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:49.864860 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7db-5d27-495a-8362-d02c22b774fd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:49.865279 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7db-5d27-495a-8362-d02c22b774fd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:49.888718 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-b3c9c7db-5d27-495a-8362-d02c22b774fd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lazy-loading 'flavor' on Instance uuid 28431df1-6972-4ad5-b90c-c1dcb54d5a98 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:03:49.957880 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b3c9c7db-5d27-495a-8362-d02c22b774fd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "POST /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98/action" status: 202 len: 0 microversion: 2.1 time: 0.107031 Oct 14 18:03:49.958455 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 479/947] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 18:03:49 2022] POST /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:03:49.966571 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-082b7b5a-8a92-4f40-94aa-39c1918299aa tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:49.967719 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-082b7b5a-8a92-4f40-94aa-39c1918299aa tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:49.973932 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-082b7b5a-8a92-4f40-94aa-39c1918299aa tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:49.974421 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-082b7b5a-8a92-4f40-94aa-39c1918299aa tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:49.974855 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-082b7b5a-8a92-4f40-94aa-39c1918299aa tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:49.975542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-082b7b5a-8a92-4f40-94aa-39c1918299aa tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:49.976022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-082b7b5a-8a92-4f40-94aa-39c1918299aa tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:49.976451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-082b7b5a-8a92-4f40-94aa-39c1918299aa tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:50.107101 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-082b7b5a-8a92-4f40-94aa-39c1918299aa tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:50.115129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-082b7b5a-8a92-4f40-94aa-39c1918299aa tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.152374 Oct 14 18:03:50.115686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 469/948] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:49 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:50.455979 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ebace25f-bfc8-411e-8531-404bea54a682 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:50.456990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ebace25f-bfc8-411e-8531-404bea54a682 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:50.462901 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebace25f-bfc8-411e-8531-404bea54a682 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:50.463376 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebace25f-bfc8-411e-8531-404bea54a682 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:50.463800 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebace25f-bfc8-411e-8531-404bea54a682 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:50.464514 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebace25f-bfc8-411e-8531-404bea54a682 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:50.464962 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebace25f-bfc8-411e-8531-404bea54a682 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:50.465379 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ebace25f-bfc8-411e-8531-404bea54a682 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:50.598769 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ebace25f-bfc8-411e-8531-404bea54a682 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:50.606875 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ebace25f-bfc8-411e-8531-404bea54a682 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1496 microversion: 2.1 time: 0.156895 Oct 14 18:03:50.607437 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 480/949] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:50 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:51.074835 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-646de09e-f172-48ae-899d-2bf104d5c56d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:51.075346 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-646de09e-f172-48ae-899d-2bf104d5c56d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:51.082534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-646de09e-f172-48ae-899d-2bf104d5c56d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:51.083010 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-646de09e-f172-48ae-899d-2bf104d5c56d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:51.083434 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-646de09e-f172-48ae-899d-2bf104d5c56d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:51.084150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-646de09e-f172-48ae-899d-2bf104d5c56d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:51.084599 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-646de09e-f172-48ae-899d-2bf104d5c56d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:51.085016 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-646de09e-f172-48ae-899d-2bf104d5c56d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:51.087574 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=74 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:51.110932 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-646de09e-f172-48ae-899d-2bf104d5c56d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Going to try to terminate instance {{(pid=118656) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:03:51.138567 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-da0f451f-667a-4e01-b9e2-3e7c55f725f6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:51.140543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-da0f451f-667a-4e01-b9e2-3e7c55f725f6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:51.147450 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da0f451f-667a-4e01-b9e2-3e7c55f725f6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:51.147904 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da0f451f-667a-4e01-b9e2-3e7c55f725f6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:51.148325 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da0f451f-667a-4e01-b9e2-3e7c55f725f6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:51.149052 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da0f451f-667a-4e01-b9e2-3e7c55f725f6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:51.149502 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da0f451f-667a-4e01-b9e2-3e7c55f725f6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:51.149922 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-da0f451f-667a-4e01-b9e2-3e7c55f725f6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:51.189112 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-646de09e-f172-48ae-899d-2bf104d5c56d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "DELETE /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 204 len: 0 microversion: 2.1 time: 0.117695 Oct 14 18:03:51.190170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 470/950] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:03:51 2022] DELETE /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:03:51.199273 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7d45f73b-a79c-435a-83de-6b22e55673c0 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:51.200009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7d45f73b-a79c-435a-83de-6b22e55673c0 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:51.206407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7d45f73b-a79c-435a-83de-6b22e55673c0 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:51.206895 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7d45f73b-a79c-435a-83de-6b22e55673c0 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:51.207340 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7d45f73b-a79c-435a-83de-6b22e55673c0 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:51.208067 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7d45f73b-a79c-435a-83de-6b22e55673c0 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:51.208523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7d45f73b-a79c-435a-83de-6b22e55673c0 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:51.208952 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7d45f73b-a79c-435a-83de-6b22e55673c0 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:51.324892 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-da0f451f-667a-4e01-b9e2-3e7c55f725f6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:51.333398 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-da0f451f-667a-4e01-b9e2-3e7c55f725f6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.198643 Oct 14 18:03:51.334051 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 481/951] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:51 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:03:51.370347 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-7d45f73b-a79c-435a-83de-6b22e55673c0 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:51.378474 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7d45f73b-a79c-435a-83de-6b22e55673c0 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1502 microversion: 2.1 time: 0.183502 Oct 14 18:03:51.379039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 471/952] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:51 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:52.356299 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2c56d333-0c35-43d4-a6fd-ed7df7ed8255 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:52.356909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2c56d333-0c35-43d4-a6fd-ed7df7ed8255 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:52.360051 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:52.360698 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:52.366405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2c56d333-0c35-43d4-a6fd-ed7df7ed8255 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:52.366888 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2c56d333-0c35-43d4-a6fd-ed7df7ed8255 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:52.367338 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2c56d333-0c35-43d4-a6fd-ed7df7ed8255 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:52.368036 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2c56d333-0c35-43d4-a6fd-ed7df7ed8255 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:52.368485 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2c56d333-0c35-43d4-a6fd-ed7df7ed8255 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:52.368904 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2c56d333-0c35-43d4-a6fd-ed7df7ed8255 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:52.401864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e7b735e8-99da-499e-85fa-aa09ae271424 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:52.402479 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e7b735e8-99da-499e-85fa-aa09ae271424 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:52.409636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b735e8-99da-499e-85fa-aa09ae271424 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:52.410122 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b735e8-99da-499e-85fa-aa09ae271424 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:52.410561 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b735e8-99da-499e-85fa-aa09ae271424 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:52.411274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b735e8-99da-499e-85fa-aa09ae271424 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:52.411730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b735e8-99da-499e-85fa-aa09ae271424 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:52.412185 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e7b735e8-99da-499e-85fa-aa09ae271424 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:52.443340 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:52.543085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2c56d333-0c35-43d4-a6fd-ed7df7ed8255 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:52.551058 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2c56d333-0c35-43d4-a6fd-ed7df7ed8255 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.198583 Oct 14 18:03:52.551632 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 482/953] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:52 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:52.578390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e7b735e8-99da-499e-85fa-aa09ae271424 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:52.586069 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e7b735e8-99da-499e-85fa-aa09ae271424 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1502 microversion: 2.1 time: 0.187985 Oct 14 18:03:52.586626 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 472/954] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:52 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:53.262973 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-f3acd73f-aa80-4bf7-add7-54666d4aa349 req-d46e7b15-57ac-42f1-95a8-a716bfd3e9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bdf311-5c5c-4787-8f25-074b7cea4e7f", "name": "network-vif-deleted", "tag": "4a5ee872-76d4-4a98-bcc3-f7c71d3167f7"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:53.274192 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-f3acd73f-aa80-4bf7-add7-54666d4aa349 req-d46e7b15-57ac-42f1-95a8-a716bfd3e9b6 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:53.274668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-f3acd73f-aa80-4bf7-add7-54666d4aa349 req-d46e7b15-57ac-42f1-95a8-a716bfd3e9b6 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:53.275137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-f3acd73f-aa80-4bf7-add7-54666d4aa349 req-d46e7b15-57ac-42f1-95a8-a716bfd3e9b6 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:53.278814 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:53.289022 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-f3acd73f-aa80-4bf7-add7-54666d4aa349 req-d46e7b15-57ac-42f1-95a8-a716bfd3e9b6 service nova] Creating event network-vif-deleted:4a5ee872-76d4-4a98-bcc3-f7c71d3167f7 for instance 29bdf311-5c5c-4787-8f25-074b7cea4e7f on hv-cinder-74915 Oct 14 18:03:53.294654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-f3acd73f-aa80-4bf7-add7-54666d4aa349 req-d46e7b15-57ac-42f1-95a8-a716bfd3e9b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035449 Oct 14 18:03:53.295248 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 483/955] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:03:53.576282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e1f84dc3-1533-4a02-96bf-40ee3e7a2ae6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:53.577309 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e1f84dc3-1533-4a02-96bf-40ee3e7a2ae6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:53.584831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f84dc3-1533-4a02-96bf-40ee3e7a2ae6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:53.585690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f84dc3-1533-4a02-96bf-40ee3e7a2ae6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:53.586468 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f84dc3-1533-4a02-96bf-40ee3e7a2ae6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:53.587657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f84dc3-1533-4a02-96bf-40ee3e7a2ae6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:53.588160 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f84dc3-1533-4a02-96bf-40ee3e7a2ae6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:53.588828 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e1f84dc3-1533-4a02-96bf-40ee3e7a2ae6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:53.611830 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:53.612774 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:53.621041 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:53.621637 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:53.622076 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:53.622804 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:53.623250 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:53.623821 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:53.657761 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:53.658240 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:53.658668 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:53.659105 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lazy-loading 'fault' on Instance uuid 29bdf311-5c5c-4787-8f25-074b7cea4e7f {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:03:53.722124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:53.730796 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-24423b60-768d-42c2-9dd6-7df35fabc158 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 200 len: 1303 microversion: 2.1 time: 0.124648 Oct 14 18:03:53.731568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 484/956] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:53 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:03:53.761000 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e1f84dc3-1533-4a02-96bf-40ee3e7a2ae6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:53.769699 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e1f84dc3-1533-4a02-96bf-40ee3e7a2ae6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.198709 Oct 14 18:03:53.770293 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 473/957] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:53 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:54.753881 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:54.754436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 29bdf311-5c5c-4787-8f25-074b7cea4e7f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:54.760891 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:54.761367 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:54.761798 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:54.762487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:54.762942 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:54.763361 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:54.777014 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] HTTP exception thrown: Instance 29bdf311-5c5c-4787-8f25-074b7cea4e7f could not be found. Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Request method failure captured: Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f HTTP/1.1 Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaR8sb_88D_yELW9Cz-cjmR_48Ct5st9s94my4qA7zaW-8rXnww9y0wFFlAsAT2at_YJqMnEQy-mqfymKSxAvPSe7Losh4w1mLrJEHjrPuQlXcS51_EAjZVmCPWZfBt5yD6S9anXOQeBcBj7x7YA0E4oZ6h2u8OMtXrqNJvwTfTU1fE Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: b0b92ab9577946a3af15e4698bd5b1e9 Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-VolumesActionsTest-2088591025 Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:03:54.778616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b0b92ab9577946a3af15e4698bd5b1e9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0b92ab9577946a3af15e4698bd5b1e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b0b92ab9577946a3af15e4698bd5b1e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0b92ab9577946a3af15e4698bd5b1e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-VolumesActionsTest-2088591025 Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: b0b92ab9577946a3af15e4698bd5b1e9 Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-VolumesActionsTest-2088591025 Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-VolumesActionsTest-2088591025-project Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 20b39293079c4ec68aa1482bc7adee96 Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-VolumesActionsTest-2088591025-project Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 29bdf311-5c5c-4787-8f25-074b7cea4e7f could not be found. Oct 14 18:03:54.780940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '29bdf311-5c5c-4787-8f25-074b7cea4e7f'} Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29bdf311-5c5c-4787-8f25-074b7cea4e7f could not be found. Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:03:54.781824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29bdf311-5c5c-4787-8f25-074b7cea4e7f could not be found. Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29bdf311-5c5c-4787-8f25-074b7cea4e7f could not be found. Oct 14 18:03:54.783147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:03:54.784379 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Returning 404 to user: Instance 29bdf311-5c5c-4787-8f25-074b7cea4e7f could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:03:54.784379 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-14fbb25f-b669-449c-b7c9-379aa32724bf tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f" status: 404 len: 111 microversion: 2.1 time: 0.030052 Oct 14 18:03:54.784379 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 485/958] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:54 2022] GET /compute/v2.1/servers/29bdf311-5c5c-4787-8f25-074b7cea4e7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:03:54.794675 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-87dd3fe7-1de9-49f4-a8f8-b8fd49177264 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:54.795285 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-87dd3fe7-1de9-49f4-a8f8-b8fd49177264 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:54.797592 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 18:03:54.797736 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Fri Oct 14 18:03:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 (ip 10.222.0.27) !!! Oct 14 18:03:54.812880 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-87dd3fe7-1de9-49f4-a8f8-b8fd49177264 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:54.813379 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-87dd3fe7-1de9-49f4-a8f8-b8fd49177264 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:54.813818 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-87dd3fe7-1de9-49f4-a8f8-b8fd49177264 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:54.814527 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-87dd3fe7-1de9-49f4-a8f8-b8fd49177264 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:54.814984 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-87dd3fe7-1de9-49f4-a8f8-b8fd49177264 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:54.815409 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-87dd3fe7-1de9-49f4-a8f8-b8fd49177264 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:54.829629 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-963731339", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "networks": [{"uuid": "52d83ba1-6fb0-435a-a3bb-555ed9736066"}]}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:54.886130 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] validate_networks() for [('52d83ba1-6fb0-435a-a3bb-555ed9736066', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 18:03:55.015213 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-87dd3fe7-1de9-49f4-a8f8-b8fd49177264 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:55.023467 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-87dd3fe7-1de9-49f4-a8f8-b8fd49177264 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.232717 Oct 14 18:03:55.024147 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 474/959] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:54 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:55.278245 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 18:03:55.278664 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 18:03:55.279138 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 18:03:55.279542 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 18:03:55.279976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 18:03:55.288742 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:55.289215 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:55.289643 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:55.290384 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:55.290829 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:55.291246 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:55.308034 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Getting quotas for project b0b92ab9577946a3af15e4698bd5b1e9. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:03:55.312125 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Getting quotas for user 20b39293079c4ec68aa1482bc7adee96 and project b0b92ab9577946a3af15e4698bd5b1e9. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:03:55.322741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 18:03:55.325012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 18:03:55.370349 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4c39e724-59d3-4ea2-bcf1-25f8e092958c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545239 Oct 14 18:03:55.370987 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 486/960] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 18:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 18:03:55.382237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1d8decb7-f180-4474-8583-a425c804f0db tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:55.382843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1d8decb7-f180-4474-8583-a425c804f0db tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:55.437126 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-1d8decb7-f180-4474-8583-a425c804f0db tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:55.444474 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1d8decb7-f180-4474-8583-a425c804f0db tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1213 microversion: 2.1 time: 0.066167 Oct 14 18:03:55.445041 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 475/961] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:55 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:56.048105 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6f86e67d-c448-44d5-a579-ac8626854668 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:56.048720 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6f86e67d-c448-44d5-a579-ac8626854668 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:56.054757 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6f86e67d-c448-44d5-a579-ac8626854668 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:56.055234 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6f86e67d-c448-44d5-a579-ac8626854668 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:56.055950 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6f86e67d-c448-44d5-a579-ac8626854668 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:56.056640 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6f86e67d-c448-44d5-a579-ac8626854668 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:56.057088 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6f86e67d-c448-44d5-a579-ac8626854668 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:56.057506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6f86e67d-c448-44d5-a579-ac8626854668 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:56.188527 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6f86e67d-c448-44d5-a579-ac8626854668 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:56.196093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6f86e67d-c448-44d5-a579-ac8626854668 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.153457 Oct 14 18:03:56.196647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 487/962] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:56 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:56.468320 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5a5ba3eb-8e1f-4f97-b628-49d78398077c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:56.468878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-5a5ba3eb-8e1f-4f97-b628-49d78398077c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:56.475075 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a5ba3eb-8e1f-4f97-b628-49d78398077c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:56.475713 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a5ba3eb-8e1f-4f97-b628-49d78398077c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:56.476015 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a5ba3eb-8e1f-4f97-b628-49d78398077c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:56.476910 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a5ba3eb-8e1f-4f97-b628-49d78398077c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:56.477523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a5ba3eb-8e1f-4f97-b628-49d78398077c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:56.477947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5a5ba3eb-8e1f-4f97-b628-49d78398077c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:56.544014 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5a5ba3eb-8e1f-4f97-b628-49d78398077c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:56.553294 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-5a5ba3eb-8e1f-4f97-b628-49d78398077c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1273 microversion: 2.1 time: 0.088711 Oct 14 18:03:56.554338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 476/963] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:56 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:57.219457 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bcab8ff1-c41c-43c3-ad25-623f677cffc7 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:57.220045 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bcab8ff1-c41c-43c3-ad25-623f677cffc7 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:57.226827 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcab8ff1-c41c-43c3-ad25-623f677cffc7 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:57.227318 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcab8ff1-c41c-43c3-ad25-623f677cffc7 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:57.227754 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcab8ff1-c41c-43c3-ad25-623f677cffc7 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:57.228486 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcab8ff1-c41c-43c3-ad25-623f677cffc7 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:57.228940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcab8ff1-c41c-43c3-ad25-623f677cffc7 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:57.229364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bcab8ff1-c41c-43c3-ad25-623f677cffc7 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:57.366992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-bcab8ff1-c41c-43c3-ad25-623f677cffc7 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:57.375149 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bcab8ff1-c41c-43c3-ad25-623f677cffc7 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.160284 Oct 14 18:03:57.375716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 488/964] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:57 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:57.576764 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a10f49cd-8284-4f42-8a57-2e9797277304 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:57.578379 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a10f49cd-8284-4f42-8a57-2e9797277304 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:57.584453 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a10f49cd-8284-4f42-8a57-2e9797277304 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:57.584934 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a10f49cd-8284-4f42-8a57-2e9797277304 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:57.585369 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a10f49cd-8284-4f42-8a57-2e9797277304 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:57.586063 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a10f49cd-8284-4f42-8a57-2e9797277304 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:57.586515 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a10f49cd-8284-4f42-8a57-2e9797277304 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:57.586935 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a10f49cd-8284-4f42-8a57-2e9797277304 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:57.717099 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a10f49cd-8284-4f42-8a57-2e9797277304 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:57.725089 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a10f49cd-8284-4f42-8a57-2e9797277304 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1313 microversion: 2.1 time: 0.152159 Oct 14 18:03:57.725718 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 477/965] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:57 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:58.002697 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-0f1956aa-9a07-43b9-9888-0630ae741b71 req-07113a13-6ca3-4f53-883f-70a50fb347d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3", "tag": "f8ddfed0-39f2-4230-b124-d320c480df40"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:03:58.012915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-0f1956aa-9a07-43b9-9888-0630ae741b71 req-07113a13-6ca3-4f53-883f-70a50fb347d5 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:58.013509 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-0f1956aa-9a07-43b9-9888-0630ae741b71 req-07113a13-6ca3-4f53-883f-70a50fb347d5 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:58.013927 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-0f1956aa-9a07-43b9-9888-0630ae741b71 req-07113a13-6ca3-4f53-883f-70a50fb347d5 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:58.026561 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-0f1956aa-9a07-43b9-9888-0630ae741b71 req-07113a13-6ca3-4f53-883f-70a50fb347d5 service nova] Creating event network-changed:f8ddfed0-39f2-4230-b124-d320c480df40 for instance 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 on hv-cinder-74915 Oct 14 18:03:58.032008 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-0f1956aa-9a07-43b9-9888-0630ae741b71 req-07113a13-6ca3-4f53-883f-70a50fb347d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034001 Oct 14 18:03:58.032597 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 489/966] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:03:58.399002 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fff7a89b-1b2e-41bc-b501-cb17d65d8926 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:58.399605 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fff7a89b-1b2e-41bc-b501-cb17d65d8926 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:58.405567 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fff7a89b-1b2e-41bc-b501-cb17d65d8926 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:58.406048 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fff7a89b-1b2e-41bc-b501-cb17d65d8926 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:58.406478 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fff7a89b-1b2e-41bc-b501-cb17d65d8926 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:58.407169 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fff7a89b-1b2e-41bc-b501-cb17d65d8926 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:58.407618 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fff7a89b-1b2e-41bc-b501-cb17d65d8926 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:58.408075 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fff7a89b-1b2e-41bc-b501-cb17d65d8926 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:58.540968 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fff7a89b-1b2e-41bc-b501-cb17d65d8926 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:58.549506 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fff7a89b-1b2e-41bc-b501-cb17d65d8926 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.154361 Oct 14 18:03:58.550077 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 478/967] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:58 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:58.749733 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a649bee3-8b4d-44c2-871f-b7eb51d2c2f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:58.750334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a649bee3-8b4d-44c2-871f-b7eb51d2c2f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:58.756495 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a649bee3-8b4d-44c2-871f-b7eb51d2c2f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:58.756970 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a649bee3-8b4d-44c2-871f-b7eb51d2c2f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:58.757402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a649bee3-8b4d-44c2-871f-b7eb51d2c2f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:58.758115 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a649bee3-8b4d-44c2-871f-b7eb51d2c2f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:58.758565 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a649bee3-8b4d-44c2-871f-b7eb51d2c2f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:58.758983 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a649bee3-8b4d-44c2-871f-b7eb51d2c2f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:58.885385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a649bee3-8b4d-44c2-871f-b7eb51d2c2f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:58.892961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a649bee3-8b4d-44c2-871f-b7eb51d2c2f7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1313 microversion: 2.1 time: 0.148165 Oct 14 18:03:58.893522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 490/968] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:58 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:58.959794 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c0df373c-2320-4919-b165-ca9358ddb71f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:58.960358 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c0df373c-2320-4919-b165-ca9358ddb71f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:58.966623 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0df373c-2320-4919-b165-ca9358ddb71f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:58.967101 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0df373c-2320-4919-b165-ca9358ddb71f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:58.968251 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0df373c-2320-4919-b165-ca9358ddb71f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:58.968926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0df373c-2320-4919-b165-ca9358ddb71f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:58.969381 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0df373c-2320-4919-b165-ca9358ddb71f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:58.969805 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c0df373c-2320-4919-b165-ca9358ddb71f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:58.992532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c0df373c-2320-4919-b165-ca9358ddb71f tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/ips" status: 200 len: 151 microversion: 2.1 time: 0.036540 Oct 14 18:03:58.993091 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 479/969] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Oct 14 18:03:58 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:03:59.572867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a082f7d7-d7cd-47ae-b170-a0ba50b4f101 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:59.573470 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a082f7d7-d7cd-47ae-b170-a0ba50b4f101 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:59.580089 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a082f7d7-d7cd-47ae-b170-a0ba50b4f101 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:59.580567 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a082f7d7-d7cd-47ae-b170-a0ba50b4f101 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:59.580989 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a082f7d7-d7cd-47ae-b170-a0ba50b4f101 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:59.581669 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a082f7d7-d7cd-47ae-b170-a0ba50b4f101 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:59.582116 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a082f7d7-d7cd-47ae-b170-a0ba50b4f101 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:59.582530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a082f7d7-d7cd-47ae-b170-a0ba50b4f101 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:59.717311 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a082f7d7-d7cd-47ae-b170-a0ba50b4f101 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:03:59.725638 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a082f7d7-d7cd-47ae-b170-a0ba50b4f101 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.156933 Oct 14 18:03:59.726204 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 491/970] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:59 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:03:59.916080 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4e0cf6f4-51ab-4e69-8d26-6aebdec3f229 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:03:59.916696 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4e0cf6f4-51ab-4e69-8d26-6aebdec3f229 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:03:59.923532 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e0cf6f4-51ab-4e69-8d26-6aebdec3f229 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:59.924288 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e0cf6f4-51ab-4e69-8d26-6aebdec3f229 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:59.924732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e0cf6f4-51ab-4e69-8d26-6aebdec3f229 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:03:59.925424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e0cf6f4-51ab-4e69-8d26-6aebdec3f229 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:03:59.925878 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e0cf6f4-51ab-4e69-8d26-6aebdec3f229 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:03:59.926304 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e0cf6f4-51ab-4e69-8d26-6aebdec3f229 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:00.052330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-4e0cf6f4-51ab-4e69-8d26-6aebdec3f229 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:00.060110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4e0cf6f4-51ab-4e69-8d26-6aebdec3f229 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1313 microversion: 2.1 time: 0.147856 Oct 14 18:04:00.060672 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 480/971] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:03:59 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:00.327586 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bb0743d4-fdc6-40fb-abf1-a258b83e7fe7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88ea7a3a-86e6-4a75-869d-210da1328be8"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:00.330000 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bb0743d4-fdc6-40fb-abf1-a258b83e7fe7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:00.336067 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb0743d4-fdc6-40fb-abf1-a258b83e7fe7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:00.336555 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb0743d4-fdc6-40fb-abf1-a258b83e7fe7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:00.336990 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb0743d4-fdc6-40fb-abf1-a258b83e7fe7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:00.337685 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb0743d4-fdc6-40fb-abf1-a258b83e7fe7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:00.338138 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb0743d4-fdc6-40fb-abf1-a258b83e7fe7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:00.338564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bb0743d4-fdc6-40fb-abf1-a258b83e7fe7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:00.590541 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bb0743d4-fdc6-40fb-abf1-a258b83e7fe7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266753 Oct 14 18:04:00.591137 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 492/972] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 18:04:00 2022] POST /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:04:00.749419 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-84ffbec8-b9c3-4398-a1e8-195b266dc953 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:00.750022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-84ffbec8-b9c3-4398-a1e8-195b266dc953 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:00.756408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-84ffbec8-b9c3-4398-a1e8-195b266dc953 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:00.757021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-84ffbec8-b9c3-4398-a1e8-195b266dc953 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:00.757460 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-84ffbec8-b9c3-4398-a1e8-195b266dc953 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:00.758153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-84ffbec8-b9c3-4398-a1e8-195b266dc953 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:00.758703 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-84ffbec8-b9c3-4398-a1e8-195b266dc953 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:00.759157 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-84ffbec8-b9c3-4398-a1e8-195b266dc953 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:00.891662 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-84ffbec8-b9c3-4398-a1e8-195b266dc953 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:00.899582 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-84ffbec8-b9c3-4398-a1e8-195b266dc953 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.154319 Oct 14 18:04:00.900189 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 481/973] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:00 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:01.084339 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d3f03b4c-bc61-4604-a5c4-475b24eeedd8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:01.085031 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d3f03b4c-bc61-4604-a5c4-475b24eeedd8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:01.091241 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3f03b4c-bc61-4604-a5c4-475b24eeedd8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:01.091692 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3f03b4c-bc61-4604-a5c4-475b24eeedd8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:01.092155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3f03b4c-bc61-4604-a5c4-475b24eeedd8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:01.093652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3f03b4c-bc61-4604-a5c4-475b24eeedd8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:01.094103 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3f03b4c-bc61-4604-a5c4-475b24eeedd8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:01.094526 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3f03b4c-bc61-4604-a5c4-475b24eeedd8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:01.230227 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d3f03b4c-bc61-4604-a5c4-475b24eeedd8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:01.238471 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d3f03b4c-bc61-4604-a5c4-475b24eeedd8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1313 microversion: 2.1 time: 0.158761 Oct 14 18:04:01.239028 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 493/974] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:01 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:01.924020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-0295ab0a-7e7b-41ac-a924-559a03f7aaa9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:01.924551 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-0295ab0a-7e7b-41ac-a924-559a03f7aaa9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:01.931254 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0295ab0a-7e7b-41ac-a924-559a03f7aaa9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:01.931735 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0295ab0a-7e7b-41ac-a924-559a03f7aaa9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:01.932207 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0295ab0a-7e7b-41ac-a924-559a03f7aaa9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:01.932892 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0295ab0a-7e7b-41ac-a924-559a03f7aaa9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:01.933343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0295ab0a-7e7b-41ac-a924-559a03f7aaa9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:01.933764 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-0295ab0a-7e7b-41ac-a924-559a03f7aaa9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:02.061555 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-0295ab0a-7e7b-41ac-a924-559a03f7aaa9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:02.069443 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-0295ab0a-7e7b-41ac-a924-559a03f7aaa9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.149971 Oct 14 18:04:02.070011 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 482/975] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:01 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:02.261403 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-645b988f-8379-407e-b1df-c35f4e4b01d6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:02.261923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-645b988f-8379-407e-b1df-c35f4e4b01d6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:02.268418 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-645b988f-8379-407e-b1df-c35f4e4b01d6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:02.268892 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-645b988f-8379-407e-b1df-c35f4e4b01d6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:02.269314 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-645b988f-8379-407e-b1df-c35f4e4b01d6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:02.270023 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-645b988f-8379-407e-b1df-c35f4e4b01d6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:02.270467 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-645b988f-8379-407e-b1df-c35f4e4b01d6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:02.270882 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-645b988f-8379-407e-b1df-c35f4e4b01d6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:02.491833 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-3fadd7b8-b6ef-40c5-91f0-3fad32252395 req-355a7ef2-3cdc-4c34-8a5d-0d458db9b0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3", "name": "network-vif-plugged", "status": "completed", "tag": "f8ddfed0-39f2-4230-b124-d320c480df40"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:02.505902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-3fadd7b8-b6ef-40c5-91f0-3fad32252395 req-355a7ef2-3cdc-4c34-8a5d-0d458db9b0b4 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:02.506601 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-3fadd7b8-b6ef-40c5-91f0-3fad32252395 req-355a7ef2-3cdc-4c34-8a5d-0d458db9b0b4 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:02.507207 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-3fadd7b8-b6ef-40c5-91f0-3fad32252395 req-355a7ef2-3cdc-4c34-8a5d-0d458db9b0b4 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:02.521417 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-3fadd7b8-b6ef-40c5-91f0-3fad32252395 req-355a7ef2-3cdc-4c34-8a5d-0d458db9b0b4 service nova] Creating event network-vif-plugged:f8ddfed0-39f2-4230-b124-d320c480df40 for instance 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 on hv-cinder-74915 Oct 14 18:04:02.534066 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-3fadd7b8-b6ef-40c5-91f0-3fad32252395 req-355a7ef2-3cdc-4c34-8a5d-0d458db9b0b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046243 Oct 14 18:04:02.534997 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 483/976] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:04:02.585210 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-645b988f-8379-407e-b1df-c35f4e4b01d6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:02.595752 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-645b988f-8379-407e-b1df-c35f4e4b01d6 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1313 microversion: 2.1 time: 0.338257 Oct 14 18:04:02.596749 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 494/977] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:02 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:03.094173 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3a826828-f475-4f50-8a33-5621e23ed383 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:03.094862 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3a826828-f475-4f50-8a33-5621e23ed383 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:03.101055 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a826828-f475-4f50-8a33-5621e23ed383 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:03.101534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a826828-f475-4f50-8a33-5621e23ed383 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:03.101964 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a826828-f475-4f50-8a33-5621e23ed383 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:03.102650 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a826828-f475-4f50-8a33-5621e23ed383 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:03.103097 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a826828-f475-4f50-8a33-5621e23ed383 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:03.103516 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a826828-f475-4f50-8a33-5621e23ed383 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:03.235004 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3a826828-f475-4f50-8a33-5621e23ed383 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:03.242605 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3a826828-f475-4f50-8a33-5621e23ed383 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.153864 Oct 14 18:04:03.243161 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 484/978] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:03 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:03.620416 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ce90efa6-ffab-4b14-8fc8-4600492df1af tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:03.620950 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ce90efa6-ffab-4b14-8fc8-4600492df1af tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:03.623322 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:03.629736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce90efa6-ffab-4b14-8fc8-4600492df1af tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:03.630225 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce90efa6-ffab-4b14-8fc8-4600492df1af tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:03.630660 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce90efa6-ffab-4b14-8fc8-4600492df1af tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:03.631348 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce90efa6-ffab-4b14-8fc8-4600492df1af tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:03.631796 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce90efa6-ffab-4b14-8fc8-4600492df1af tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:03.632241 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ce90efa6-ffab-4b14-8fc8-4600492df1af tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:03.759648 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ce90efa6-ffab-4b14-8fc8-4600492df1af tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:03.767901 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ce90efa6-ffab-4b14-8fc8-4600492df1af tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1313 microversion: 2.1 time: 0.151375 Oct 14 18:04:03.768475 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 495/979] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:03 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:04.266389 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-50595cb6-3ebb-44d9-8aa0-721d14000207 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:04.267011 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-50595cb6-3ebb-44d9-8aa0-721d14000207 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:04.273902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50595cb6-3ebb-44d9-8aa0-721d14000207 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:04.274408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50595cb6-3ebb-44d9-8aa0-721d14000207 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:04.274829 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50595cb6-3ebb-44d9-8aa0-721d14000207 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:04.275525 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50595cb6-3ebb-44d9-8aa0-721d14000207 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:04.276006 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50595cb6-3ebb-44d9-8aa0-721d14000207 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:04.276514 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-50595cb6-3ebb-44d9-8aa0-721d14000207 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:04.417238 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-50595cb6-3ebb-44d9-8aa0-721d14000207 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:04.425593 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-50595cb6-3ebb-44d9-8aa0-721d14000207 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.163838 Oct 14 18:04:04.426153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 485/980] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:04 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:04.792109 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f96d6372-cca2-425f-b087-3624c8f6304d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:04.792698 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f96d6372-cca2-425f-b087-3624c8f6304d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:04.799200 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f96d6372-cca2-425f-b087-3624c8f6304d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:04.799671 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f96d6372-cca2-425f-b087-3624c8f6304d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:04.800126 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f96d6372-cca2-425f-b087-3624c8f6304d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:04.800832 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f96d6372-cca2-425f-b087-3624c8f6304d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:04.801277 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f96d6372-cca2-425f-b087-3624c8f6304d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:04.801700 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f96d6372-cca2-425f-b087-3624c8f6304d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:04.929108 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f96d6372-cca2-425f-b087-3624c8f6304d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:04.937684 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f96d6372-cca2-425f-b087-3624c8f6304d tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1497 microversion: 2.1 time: 0.149261 Oct 14 18:04:04.938236 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 496/981] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:04 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:05.395293 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-1a69d8e3-fc94-4553-b6ba-3de8653c8223 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:05.395861 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1a69d8e3-fc94-4553-b6ba-3de8653c8223 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:05.402289 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a69d8e3-fc94-4553-b6ba-3de8653c8223 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:05.402779 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a69d8e3-fc94-4553-b6ba-3de8653c8223 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:05.403216 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a69d8e3-fc94-4553-b6ba-3de8653c8223 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:05.403933 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a69d8e3-fc94-4553-b6ba-3de8653c8223 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:05.404393 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a69d8e3-fc94-4553-b6ba-3de8653c8223 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:05.404819 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-1a69d8e3-fc94-4553-b6ba-3de8653c8223 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:05.436995 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-1a69d8e3-fc94-4553-b6ba-3de8653c8223 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Going to try to terminate instance {{(pid=118656) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:04:05.442378 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:05.449602 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-07af32a0-48fb-414e-b6e9-a2f0e1689de2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:05.450178 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-07af32a0-48fb-414e-b6e9-a2f0e1689de2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:05.453479 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:05.455380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:05.456619 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:05.458874 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07af32a0-48fb-414e-b6e9-a2f0e1689de2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:05.459404 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07af32a0-48fb-414e-b6e9-a2f0e1689de2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:05.459888 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07af32a0-48fb-414e-b6e9-a2f0e1689de2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:05.460610 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07af32a0-48fb-414e-b6e9-a2f0e1689de2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:05.461068 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07af32a0-48fb-414e-b6e9-a2f0e1689de2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:05.461488 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07af32a0-48fb-414e-b6e9-a2f0e1689de2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:05.532875 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-1a69d8e3-fc94-4553-b6ba-3de8653c8223 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 204 len: 0 microversion: 2.1 time: 0.141233 Oct 14 18:04:05.536719 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 486/982] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:04:05 2022] DELETE /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:04:05.542693 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e3e61104-089c-4c96-869c-04fea3af8476 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:05.543535 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e3e61104-089c-4c96-869c-04fea3af8476 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:05.549913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3e61104-089c-4c96-869c-04fea3af8476 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:05.550673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3e61104-089c-4c96-869c-04fea3af8476 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:05.551216 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3e61104-089c-4c96-869c-04fea3af8476 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:05.552147 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3e61104-089c-4c96-869c-04fea3af8476 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:05.553338 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3e61104-089c-4c96-869c-04fea3af8476 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:05.554072 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e3e61104-089c-4c96-869c-04fea3af8476 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:05.631399 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-07af32a0-48fb-414e-b6e9-a2f0e1689de2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:05.639051 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-07af32a0-48fb-414e-b6e9-a2f0e1689de2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.193429 Oct 14 18:04:05.640897 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 497/983] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:05 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:04:05.697557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e3e61104-089c-4c96-869c-04fea3af8476 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:05.706028 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e3e61104-089c-4c96-869c-04fea3af8476 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1503 microversion: 2.1 time: 0.167991 Oct 14 18:04:05.706597 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 487/984] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:05 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:04:06.663579 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b59de90d-91cc-43e1-b0f8-5572d1f0ae00 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:06.664216 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b59de90d-91cc-43e1-b0f8-5572d1f0ae00 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:06.671822 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b59de90d-91cc-43e1-b0f8-5572d1f0ae00 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:06.672436 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b59de90d-91cc-43e1-b0f8-5572d1f0ae00 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:06.672887 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b59de90d-91cc-43e1-b0f8-5572d1f0ae00 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:06.673599 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b59de90d-91cc-43e1-b0f8-5572d1f0ae00 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:06.674057 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b59de90d-91cc-43e1-b0f8-5572d1f0ae00 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:06.674485 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b59de90d-91cc-43e1-b0f8-5572d1f0ae00 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:06.729408 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-ef570890-d549-4303-8580-2b0e3408ff4a tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:06.730020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-ef570890-d549-4303-8580-2b0e3408ff4a tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:06.736950 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ef570890-d549-4303-8580-2b0e3408ff4a tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:06.737442 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ef570890-d549-4303-8580-2b0e3408ff4a tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:06.737887 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ef570890-d549-4303-8580-2b0e3408ff4a tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:06.738580 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ef570890-d549-4303-8580-2b0e3408ff4a tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:06.739039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ef570890-d549-4303-8580-2b0e3408ff4a tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:06.739466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-ef570890-d549-4303-8580-2b0e3408ff4a tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:06.845569 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b59de90d-91cc-43e1-b0f8-5572d1f0ae00 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:06.853385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b59de90d-91cc-43e1-b0f8-5572d1f0ae00 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.193615 Oct 14 18:04:06.853951 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 498/985] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:06 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:06.889590 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-ef570890-d549-4303-8580-2b0e3408ff4a tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:06.897557 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-ef570890-d549-4303-8580-2b0e3408ff4a tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1503 microversion: 2.1 time: 0.172029 Oct 14 18:04:06.898114 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 488/986] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:06 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:04:07.878421 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-db092dea-b0a0-4dd0-82db-be4d12dac22b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:07.878969 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-db092dea-b0a0-4dd0-82db-be4d12dac22b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:07.885297 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db092dea-b0a0-4dd0-82db-be4d12dac22b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:07.885778 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db092dea-b0a0-4dd0-82db-be4d12dac22b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:07.886212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db092dea-b0a0-4dd0-82db-be4d12dac22b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:07.886901 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db092dea-b0a0-4dd0-82db-be4d12dac22b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:07.887349 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db092dea-b0a0-4dd0-82db-be4d12dac22b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:07.887765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-db092dea-b0a0-4dd0-82db-be4d12dac22b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:07.920766 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-703a90d5-e55f-45d0-89b7-ede14cdc5ffe tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:07.922619 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-703a90d5-e55f-45d0-89b7-ede14cdc5ffe tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:07.928664 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-703a90d5-e55f-45d0-89b7-ede14cdc5ffe tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:07.929229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-703a90d5-e55f-45d0-89b7-ede14cdc5ffe tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:07.929873 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-703a90d5-e55f-45d0-89b7-ede14cdc5ffe tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:07.930641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-703a90d5-e55f-45d0-89b7-ede14cdc5ffe tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:07.931165 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-703a90d5-e55f-45d0-89b7-ede14cdc5ffe tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:07.931963 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-703a90d5-e55f-45d0-89b7-ede14cdc5ffe tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:08.018829 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-703a90d5-e55f-45d0-89b7-ede14cdc5ffe tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:08.036245 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-703a90d5-e55f-45d0-89b7-ede14cdc5ffe tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1461 microversion: 2.1 time: 0.119064 Oct 14 18:04:08.036839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 489/987] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:07 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1461 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:08.152526 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-271c720a-40e5-40e4-b159-53da68b1c51b req-049a6c0c-56a4-436b-9fba-044d42d4474c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3", "name": "network-vif-deleted", "tag": "f8ddfed0-39f2-4230-b124-d320c480df40"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:08.154022 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-db092dea-b0a0-4dd0-82db-be4d12dac22b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:08.162139 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-db092dea-b0a0-4dd0-82db-be4d12dac22b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.287730 Oct 14 18:04:08.162765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-271c720a-40e5-40e4-b159-53da68b1c51b req-049a6c0c-56a4-436b-9fba-044d42d4474c service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:08.162895 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 499/988] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:07 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:08.163376 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-271c720a-40e5-40e4-b159-53da68b1c51b req-049a6c0c-56a4-436b-9fba-044d42d4474c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:08.164116 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-271c720a-40e5-40e4-b159-53da68b1c51b req-049a6c0c-56a4-436b-9fba-044d42d4474c service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:08.167711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88ea7a3a-86e6-4a75-869d-210da1328be8"}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:08.170328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:08.176824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-271c720a-40e5-40e4-b159-53da68b1c51b req-049a6c0c-56a4-436b-9fba-044d42d4474c service nova] Creating event network-vif-deleted:f8ddfed0-39f2-4230-b124-d320c480df40 for instance 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 on hv-cinder-74915 Oct 14 18:04:08.177003 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:08.177441 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:08.177963 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:08.178723 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:08.179249 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:08.179676 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:08.182002 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-271c720a-40e5-40e4-b159-53da68b1c51b req-049a6c0c-56a4-436b-9fba-044d42d4474c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033622 Oct 14 18:04:08.182600 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 490/989] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:04:08.254351 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:08.260400 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Invalid volume: volume 88ea7a3a-86e6-4a75-869d-210da1328be8 is already attached to instances: c8f9f14d-978a-4f1a-95cf-38e34758bb00 Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: POST /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments HTTP/1.1 Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 74 Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:04:08.262117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {"volumeAttachment": {"volumeId": "88ea7a3a-86e6-4a75-869d-210da1328be8"}} Oct 14 18:04:08.263921 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Invalid volume: volume 88ea7a3a-86e6-4a75-869d-210da1328be8 is already attached to instances: c8f9f14d-978a-4f1a-95cf-38e34758bb00 Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'server_id': 'c8f9f14d-978a-4f1a-95cf-38e34758bb00', 'body': {'volumeAttachment': {'volumeId': '88ea7a3a-86e6-4a75-869d-210da1328be8'}}} Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 88ea7a3a-86e6-4a75-869d-210da1328be8 is already attached to instances: c8f9f14d-978a-4f1a-95cf-38e34758bb00 Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:04:08.265454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 88ea7a3a-86e6-4a75-869d-210da1328be8 is already attached to instances: c8f9f14d-978a-4f1a-95cf-38e34758bb00 Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:04:08.266964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:04:08.268656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:04:08.268656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:04:08.268656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:04:08.268656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 88ea7a3a-86e6-4a75-869d-210da1328be8 is already attached to instances: c8f9f14d-978a-4f1a-95cf-38e34758bb00 Oct 14 18:04:08.268656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:04:08.268656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 400 to user: Invalid volume: volume 88ea7a3a-86e6-4a75-869d-210da1328be8 is already attached to instances: c8f9f14d-978a-4f1a-95cf-38e34758bb00 {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:04:08.268656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-57d406b3-7a9b-42cf-bdf1-1fa202d1542b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099630 Oct 14 18:04:08.268656 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 500/990] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 18:04:08 2022] POST /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 18:04:08.331549 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2b5653f7-41c4-4590-b79b-e12134e2adbe tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:08.332168 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2b5653f7-41c4-4590-b79b-e12134e2adbe tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:08.338197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b5653f7-41c4-4590-b79b-e12134e2adbe tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:08.338682 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b5653f7-41c4-4590-b79b-e12134e2adbe tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:08.339117 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b5653f7-41c4-4590-b79b-e12134e2adbe tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:08.339807 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b5653f7-41c4-4590-b79b-e12134e2adbe tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:08.340293 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b5653f7-41c4-4590-b79b-e12134e2adbe tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:08.340721 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2b5653f7-41c4-4590-b79b-e12134e2adbe tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:08.422309 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-2b5653f7-41c4-4590-b79b-e12134e2adbe tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lazy-loading 'services' on Instance uuid c8f9f14d-978a-4f1a-95cf-38e34758bb00 {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:04:08.492418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2b5653f7-41c4-4590-b79b-e12134e2adbe tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments/88ea7a3a-86e6-4a75-869d-210da1328be8" status: 202 len: 0 microversion: 2.1 time: 0.164855 Oct 14 18:04:08.493004 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 491/991] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 18:04:08 2022] DELETE /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments/88ea7a3a-86e6-4a75-869d-210da1328be8 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:04:08.501408 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b4f00813-d7bd-4a2d-a244-7c1142a939a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:08.503594 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b4f00813-d7bd-4a2d-a244-7c1142a939a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:08.511534 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f00813-d7bd-4a2d-a244-7c1142a939a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:08.512059 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f00813-d7bd-4a2d-a244-7c1142a939a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:08.512495 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f00813-d7bd-4a2d-a244-7c1142a939a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:08.513189 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f00813-d7bd-4a2d-a244-7c1142a939a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:08.513642 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f00813-d7bd-4a2d-a244-7c1142a939a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:08.514065 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4f00813-d7bd-4a2d-a244-7c1142a939a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:08.542782 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b4f00813-d7bd-4a2d-a244-7c1142a939a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Oct 14 18:04:08.543321 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 501/992] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:04:08 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:04:09.063105 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c3ef92bc-c316-46d2-a9c1-962923616fe7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:09.063795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c3ef92bc-c316-46d2-a9c1-962923616fe7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:09.069918 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3ef92bc-c316-46d2-a9c1-962923616fe7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:09.070393 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3ef92bc-c316-46d2-a9c1-962923616fe7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:09.070822 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3ef92bc-c316-46d2-a9c1-962923616fe7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:09.071570 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3ef92bc-c316-46d2-a9c1-962923616fe7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:09.072054 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3ef92bc-c316-46d2-a9c1-962923616fe7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:09.072470 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c3ef92bc-c316-46d2-a9c1-962923616fe7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:09.136536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c3ef92bc-c316-46d2-a9c1-962923616fe7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:09.145261 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c3ef92bc-c316-46d2-a9c1-962923616fe7 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1461 microversion: 2.1 time: 0.086915 Oct 14 18:04:09.145824 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 492/993] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:09 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1461 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:09.186156 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f13006a7-daed-436e-a649-39c9dab8b09b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:09.187564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f13006a7-daed-436e-a649-39c9dab8b09b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:09.194857 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f13006a7-daed-436e-a649-39c9dab8b09b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:09.195465 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f13006a7-daed-436e-a649-39c9dab8b09b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:09.196009 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f13006a7-daed-436e-a649-39c9dab8b09b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:09.196801 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f13006a7-daed-436e-a649-39c9dab8b09b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:09.197328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f13006a7-daed-436e-a649-39c9dab8b09b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:09.197825 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f13006a7-daed-436e-a649-39c9dab8b09b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:09.339327 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f13006a7-daed-436e-a649-39c9dab8b09b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:09.347238 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f13006a7-daed-436e-a649-39c9dab8b09b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.164907 Oct 14 18:04:09.347799 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 502/994] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:09 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:09.555274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-957f290b-a2d1-43c4-9d1f-e405937345ac tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:09.557845 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-957f290b-a2d1-43c4-9d1f-e405937345ac tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:09.563752 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-957f290b-a2d1-43c4-9d1f-e405937345ac tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:09.564294 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-957f290b-a2d1-43c4-9d1f-e405937345ac tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:09.564730 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-957f290b-a2d1-43c4-9d1f-e405937345ac tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:09.565411 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-957f290b-a2d1-43c4-9d1f-e405937345ac tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:09.565859 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-957f290b-a2d1-43c4-9d1f-e405937345ac tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:09.566274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-957f290b-a2d1-43c4-9d1f-e405937345ac tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:09.595790 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-957f290b-a2d1-43c4-9d1f-e405937345ac tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044401 Oct 14 18:04:09.596300 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 493/995] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:04:09 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:04:10.178923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:10.180375 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:10.193920 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.196084 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.196904 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.197960 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.198680 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.199184 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.242000 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.242645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.243274 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.243800 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.objects.instance [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lazy-loading 'fault' on Instance uuid 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 {{(pid=118655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:04:10.290983 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b39293079c4ec68aa1482bc7adee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b92ab9577946a3af15e4698bd5b1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:10.300197 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-1193e825-38b9-4da9-8368-99692d5c74c8 tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 200 len: 1303 microversion: 2.1 time: 0.131952 Oct 14 18:04:10.301487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 503/996] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:10 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:04:10.370341 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8e907812-d96d-4a45-82fc-68fe06e46315 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:10.370948 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8e907812-d96d-4a45-82fc-68fe06e46315 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:10.386303 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e907812-d96d-4a45-82fc-68fe06e46315 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.386791 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e907812-d96d-4a45-82fc-68fe06e46315 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.387223 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e907812-d96d-4a45-82fc-68fe06e46315 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.388163 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e907812-d96d-4a45-82fc-68fe06e46315 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.388615 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e907812-d96d-4a45-82fc-68fe06e46315 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.389033 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8e907812-d96d-4a45-82fc-68fe06e46315 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.522220 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8e907812-d96d-4a45-82fc-68fe06e46315 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:10.529884 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8e907812-d96d-4a45-82fc-68fe06e46315 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1567 microversion: 2.1 time: 0.163347 Oct 14 18:04:10.530508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 494/997] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:10 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:10.553215 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ced94e6a-a80e-440a-9790-19c89018684f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:10.553902 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ced94e6a-a80e-440a-9790-19c89018684f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:10.560310 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ced94e6a-a80e-440a-9790-19c89018684f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.560788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ced94e6a-a80e-440a-9790-19c89018684f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.561212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ced94e6a-a80e-440a-9790-19c89018684f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.562552 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ced94e6a-a80e-440a-9790-19c89018684f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.563013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ced94e6a-a80e-440a-9790-19c89018684f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.563420 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ced94e6a-a80e-440a-9790-19c89018684f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.591627 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ced94e6a-a80e-440a-9790-19c89018684f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118655) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 18:04:10.608929 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-137331d8-cdb6-4c26-9558-4d89ee890dd7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:10.611201 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-137331d8-cdb6-4c26-9558-4d89ee890dd7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:10.617435 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-137331d8-cdb6-4c26-9558-4d89ee890dd7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.617923 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-137331d8-cdb6-4c26-9558-4d89ee890dd7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.618362 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-137331d8-cdb6-4c26-9558-4d89ee890dd7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.619065 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-137331d8-cdb6-4c26-9558-4d89ee890dd7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.619517 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-137331d8-cdb6-4c26-9558-4d89ee890dd7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.619970 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-137331d8-cdb6-4c26-9558-4d89ee890dd7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.652028 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-137331d8-cdb6-4c26-9558-4d89ee890dd7 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047750 Oct 14 18:04:10.652519 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 495/998] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:04:10 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 18:04:10.659205 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ced94e6a-a80e-440a-9790-19c89018684f tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "POST /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98/action" status: 202 len: 0 microversion: 2.1 time: 0.109956 Oct 14 18:04:10.659796 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 504/999] 10.222.0.27 () {60 vars in 1278 bytes} [Fri Oct 14 18:04:10 2022] POST /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:04:10.668214 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-02e7a088-de86-4d73-8e34-68d8d4c040a8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:10.669013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-02e7a088-de86-4d73-8e34-68d8d4c040a8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:10.677321 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02e7a088-de86-4d73-8e34-68d8d4c040a8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.678084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02e7a088-de86-4d73-8e34-68d8d4c040a8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.679114 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02e7a088-de86-4d73-8e34-68d8d4c040a8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.680310 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02e7a088-de86-4d73-8e34-68d8d4c040a8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.681062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02e7a088-de86-4d73-8e34-68d8d4c040a8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.682033 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-02e7a088-de86-4d73-8e34-68d8d4c040a8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.734299 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b3418b2e-e57f-4ba0-a796-d4e1c7ff9182 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:10.735209 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b3418b2e-e57f-4ba0-a796-d4e1c7ff9182 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:10.741466 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3418b2e-e57f-4ba0-a796-d4e1c7ff9182 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.741955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3418b2e-e57f-4ba0-a796-d4e1c7ff9182 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.742388 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3418b2e-e57f-4ba0-a796-d4e1c7ff9182 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.743085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3418b2e-e57f-4ba0-a796-d4e1c7ff9182 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.743538 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3418b2e-e57f-4ba0-a796-d4e1c7ff9182 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.744007 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b3418b2e-e57f-4ba0-a796-d4e1c7ff9182 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.784604 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b3418b2e-e57f-4ba0-a796-d4e1c7ff9182 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:04:10.842569 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-02e7a088-de86-4d73-8e34-68d8d4c040a8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:10.853752 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-02e7a088-de86-4d73-8e34-68d8d4c040a8 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1575 microversion: 2.1 time: 0.189672 Oct 14 18:04:10.859923 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 496/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:10 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:10.872764 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b3418b2e-e57f-4ba0-a796-d4e1c7ff9182 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 204 len: 0 microversion: 2.1 time: 0.142108 Oct 14 18:04:10.873648 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 505/1001] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:04:10 2022] DELETE /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 18:04:10.882976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-966efba9-659d-4612-b5de-71e51a55cd40 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:10.883814 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-966efba9-659d-4612-b5de-71e51a55cd40 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:10.890543 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-966efba9-659d-4612-b5de-71e51a55cd40 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.891150 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-966efba9-659d-4612-b5de-71e51a55cd40 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.891640 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-966efba9-659d-4612-b5de-71e51a55cd40 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:10.892454 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-966efba9-659d-4612-b5de-71e51a55cd40 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:10.892977 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-966efba9-659d-4612-b5de-71e51a55cd40 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:10.893473 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-966efba9-659d-4612-b5de-71e51a55cd40 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:11.029458 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-966efba9-659d-4612-b5de-71e51a55cd40 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:11.037713 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-966efba9-659d-4612-b5de-71e51a55cd40 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1681 microversion: 2.1 time: 0.159394 Oct 14 18:04:11.038284 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 497/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:10 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:11.325700 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:11.326390 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] [instance: 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:11.333191 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:11.333666 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:11.334097 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:11.334776 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:11.335221 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:11.335635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:11.351858 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] HTTP exception thrown: Instance 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 could not be found. Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Request method failure captured: Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 HTTP/1.1 Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaR8sb_88D_yELW9Cz-cjmR_48Ct5st9s94my4qA7zaW-8rXnww9y0wFFlAsAT2at_YJqMnEQy-mqfymKSxAvPSe7Losh4w1mLrJEHjrPuQlXcS51_EAjZVmCPWZfBt5yD6S9anXOQeBcBj7x7YA0E4oZ6h2u8OMtXrqNJvwTfTU1fE Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: b0b92ab9577946a3af15e4698bd5b1e9 Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-VolumesActionsTest-2088591025 Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:04:11.353476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b0b92ab9577946a3af15e4698bd5b1e9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0b92ab9577946a3af15e4698bd5b1e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b0b92ab9577946a3af15e4698bd5b1e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0b92ab9577946a3af15e4698bd5b1e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-VolumesActionsTest-2088591025 Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: b0b92ab9577946a3af15e4698bd5b1e9 Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-VolumesActionsTest-2088591025 Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-VolumesActionsTest-2088591025-project Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 20b39293079c4ec68aa1482bc7adee96 Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-VolumesActionsTest-2088591025-project Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 could not be found. Oct 14 18:04:11.355131 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3'} Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 could not be found. Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:04:11.356072 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 could not be found. Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 could not be found. Oct 14 18:04:11.357654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:04:11.359609 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] Returning 404 to user: Instance 6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:04:11.359609 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-dd6649ad-4e2e-4661-98f1-9fb1f173b49c tempest-VolumesActionsTest-2088591025 tempest-VolumesActionsTest-2088591025-project] 10.222.0.27 "GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3" status: 404 len: 111 microversion: 2.1 time: 0.033360 Oct 14 18:04:11.359609 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 506/1003] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:11 2022] GET /compute/v2.1/servers/6e13efb5-9fbf-4207-ad1a-8cad1fd3dbc3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:04:11.877636 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-105c602a-7444-47a0-86d5-57cb80fc7a3b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:11.878257 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-105c602a-7444-47a0-86d5-57cb80fc7a3b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:11.884765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-105c602a-7444-47a0-86d5-57cb80fc7a3b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:11.885259 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-105c602a-7444-47a0-86d5-57cb80fc7a3b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:11.885689 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-105c602a-7444-47a0-86d5-57cb80fc7a3b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:11.886377 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-105c602a-7444-47a0-86d5-57cb80fc7a3b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:11.886834 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-105c602a-7444-47a0-86d5-57cb80fc7a3b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:11.887255 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-105c602a-7444-47a0-86d5-57cb80fc7a3b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:12.023106 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-105c602a-7444-47a0-86d5-57cb80fc7a3b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:12.031099 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-105c602a-7444-47a0-86d5-57cb80fc7a3b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1515 microversion: 2.1 time: 0.157835 Oct 14 18:04:12.031679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 498/1004] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:11 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:12.065223 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-7e7f1ca9-0803-44ba-8d84-dfe675fa76f1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:12.065842 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-7e7f1ca9-0803-44ba-8d84-dfe675fa76f1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:12.072652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7e7f1ca9-0803-44ba-8d84-dfe675fa76f1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:12.073132 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7e7f1ca9-0803-44ba-8d84-dfe675fa76f1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:12.073561 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7e7f1ca9-0803-44ba-8d84-dfe675fa76f1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:12.074260 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7e7f1ca9-0803-44ba-8d84-dfe675fa76f1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:12.074711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7e7f1ca9-0803-44ba-8d84-dfe675fa76f1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:12.075133 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-7e7f1ca9-0803-44ba-8d84-dfe675fa76f1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:12.209532 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-7e7f1ca9-0803-44ba-8d84-dfe675fa76f1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:12.217101 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-7e7f1ca9-0803-44ba-8d84-dfe675fa76f1 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1681 microversion: 2.1 time: 0.156528 Oct 14 18:04:12.217647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 507/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:12 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:13.054911 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-63d00edd-6cde-4d5b-a665-b7072c7ab118 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:13.055611 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-63d00edd-6cde-4d5b-a665-b7072c7ab118 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:13.058411 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:13.064396 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-63d00edd-6cde-4d5b-a665-b7072c7ab118 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:13.064883 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-63d00edd-6cde-4d5b-a665-b7072c7ab118 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:13.065318 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-63d00edd-6cde-4d5b-a665-b7072c7ab118 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:13.066015 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-63d00edd-6cde-4d5b-a665-b7072c7ab118 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:13.066468 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-63d00edd-6cde-4d5b-a665-b7072c7ab118 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:13.066891 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-63d00edd-6cde-4d5b-a665-b7072c7ab118 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:13.199907 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-63d00edd-6cde-4d5b-a665-b7072c7ab118 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:13.208130 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-63d00edd-6cde-4d5b-a665-b7072c7ab118 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1515 microversion: 2.1 time: 0.157056 Oct 14 18:04:13.208692 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 499/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:13 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:13.240569 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-c9d1885b-ebbd-40ea-91f4-8a78734a5e06 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:13.241173 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-c9d1885b-ebbd-40ea-91f4-8a78734a5e06 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:13.247459 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9d1885b-ebbd-40ea-91f4-8a78734a5e06 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:13.247971 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9d1885b-ebbd-40ea-91f4-8a78734a5e06 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:13.248398 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9d1885b-ebbd-40ea-91f4-8a78734a5e06 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:13.249124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9d1885b-ebbd-40ea-91f4-8a78734a5e06 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:13.250314 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9d1885b-ebbd-40ea-91f4-8a78734a5e06 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:13.250736 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-c9d1885b-ebbd-40ea-91f4-8a78734a5e06 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:13.346249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-ddce4756-85d8-426a-a7ac-f6ff0f0423ac req-c1730068-3041-415f-96d9-8563a08b7177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28431df1-6972-4ad5-b90c-c1dcb54d5a98", "name": "network-vif-unplugged", "status": "completed", "tag": "f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:13.357607 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-ddce4756-85d8-426a-a7ac-f6ff0f0423ac req-c1730068-3041-415f-96d9-8563a08b7177 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:13.358172 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-ddce4756-85d8-426a-a7ac-f6ff0f0423ac req-c1730068-3041-415f-96d9-8563a08b7177 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:13.358689 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-ddce4756-85d8-426a-a7ac-f6ff0f0423ac req-c1730068-3041-415f-96d9-8563a08b7177 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:13.370683 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.compute.server_external_events [req-ddce4756-85d8-426a-a7ac-f6ff0f0423ac req-c1730068-3041-415f-96d9-8563a08b7177 service nova] Unable to find a host for instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98. Dropping event network-vif-unplugged {{(pid=118656) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 14 18:04:13.371569 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-ddce4756-85d8-426a-a7ac-f6ff0f0423ac req-c1730068-3041-415f-96d9-8563a08b7177 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030023 Oct 14 18:04:13.372181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 500/1007] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 14 18:04:13.398091 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-c9d1885b-ebbd-40ea-91f4-8a78734a5e06 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:13.406339 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-c9d1885b-ebbd-40ea-91f4-8a78734a5e06 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1681 microversion: 2.1 time: 0.169081 Oct 14 18:04:13.406920 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 508/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:13 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:14.230803 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-8b8b99ee-c01a-4807-88fe-d2a7ec7b1be9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:14.231404 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-8b8b99ee-c01a-4807-88fe-d2a7ec7b1be9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:14.238372 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b8b99ee-c01a-4807-88fe-d2a7ec7b1be9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:14.238848 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b8b99ee-c01a-4807-88fe-d2a7ec7b1be9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:14.239276 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b8b99ee-c01a-4807-88fe-d2a7ec7b1be9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:14.239980 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b8b99ee-c01a-4807-88fe-d2a7ec7b1be9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:14.240430 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b8b99ee-c01a-4807-88fe-d2a7ec7b1be9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:14.240851 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-8b8b99ee-c01a-4807-88fe-d2a7ec7b1be9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:14.371727 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-8b8b99ee-c01a-4807-88fe-d2a7ec7b1be9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:14.380181 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-8b8b99ee-c01a-4807-88fe-d2a7ec7b1be9 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1515 microversion: 2.1 time: 0.153086 Oct 14 18:04:14.380751 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 501/1009] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:14 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:14.432027 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ff5d9326-4ee9-4b3f-9001-9ff0aa657656 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:14.432564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ff5d9326-4ee9-4b3f-9001-9ff0aa657656 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:14.439079 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ff5d9326-4ee9-4b3f-9001-9ff0aa657656 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:14.439566 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ff5d9326-4ee9-4b3f-9001-9ff0aa657656 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:14.440029 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ff5d9326-4ee9-4b3f-9001-9ff0aa657656 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:14.440722 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ff5d9326-4ee9-4b3f-9001-9ff0aa657656 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:14.441171 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ff5d9326-4ee9-4b3f-9001-9ff0aa657656 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:14.441593 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ff5d9326-4ee9-4b3f-9001-9ff0aa657656 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:14.567794 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ff5d9326-4ee9-4b3f-9001-9ff0aa657656 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:14.575347 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ff5d9326-4ee9-4b3f-9001-9ff0aa657656 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1681 microversion: 2.1 time: 0.147469 Oct 14 18:04:14.575915 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 509/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:14 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:15.402374 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a4a4382d-02c7-440c-b7b6-76f3dbc16107 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:15.402982 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a4a4382d-02c7-440c-b7b6-76f3dbc16107 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:15.411141 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a4a4382d-02c7-440c-b7b6-76f3dbc16107 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:15.411566 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a4a4382d-02c7-440c-b7b6-76f3dbc16107 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:15.412029 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a4a4382d-02c7-440c-b7b6-76f3dbc16107 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:15.412738 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a4a4382d-02c7-440c-b7b6-76f3dbc16107 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:15.413191 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a4a4382d-02c7-440c-b7b6-76f3dbc16107 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:15.413617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a4a4382d-02c7-440c-b7b6-76f3dbc16107 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:15.599008 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4dbd0814-321c-4caf-beb8-c20bb18c1442 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:15.599621 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4dbd0814-321c-4caf-beb8-c20bb18c1442 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:15.606351 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4dbd0814-321c-4caf-beb8-c20bb18c1442 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:15.606832 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4dbd0814-321c-4caf-beb8-c20bb18c1442 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:15.607266 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4dbd0814-321c-4caf-beb8-c20bb18c1442 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:15.607992 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4dbd0814-321c-4caf-beb8-c20bb18c1442 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:15.609013 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4dbd0814-321c-4caf-beb8-c20bb18c1442 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:15.609643 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4dbd0814-321c-4caf-beb8-c20bb18c1442 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:15.645519 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a4a4382d-02c7-440c-b7b6-76f3dbc16107 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:15.647868 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:15.654816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a4a4382d-02c7-440c-b7b6-76f3dbc16107 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1517 microversion: 2.1 time: 0.256228 Oct 14 18:04:15.655522 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 502/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:15 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:15.821373 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-4dbd0814-321c-4caf-beb8-c20bb18c1442 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:15.829326 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4dbd0814-321c-4caf-beb8-c20bb18c1442 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1681 microversion: 2.1 time: 0.234529 Oct 14 18:04:15.829887 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 510/1012] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:15 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:04:16.492395 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-29e4d72b-02d0-4964-9561-7d517024ef1d req-f78e6cea-8b30-4320-b278-76a2430fe7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f9f14d-978a-4f1a-95cf-38e34758bb00", "name": "network-vif-deleted", "tag": "53884c64-df9a-4e54-bf1f-86264cf92326"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:16.509022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-29e4d72b-02d0-4964-9561-7d517024ef1d req-f78e6cea-8b30-4320-b278-76a2430fe7bf service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:16.509873 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-29e4d72b-02d0-4964-9561-7d517024ef1d req-f78e6cea-8b30-4320-b278-76a2430fe7bf service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:16.510798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-29e4d72b-02d0-4964-9561-7d517024ef1d req-f78e6cea-8b30-4320-b278-76a2430fe7bf service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:16.523425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-29e4d72b-02d0-4964-9561-7d517024ef1d req-f78e6cea-8b30-4320-b278-76a2430fe7bf service nova] Creating event network-vif-deleted:53884c64-df9a-4e54-bf1f-86264cf92326 for instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 on hv-cinder-74915 Oct 14 18:04:16.529624 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-29e4d72b-02d0-4964-9561-7d517024ef1d req-f78e6cea-8b30-4320-b278-76a2430fe7bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042901 Oct 14 18:04:16.534930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 503/1013] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:04:16.683507 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d5e8575f-ff7d-4865-9763-f0c3a0e3d5a5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:16.685510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d5e8575f-ff7d-4865-9763-f0c3a0e3d5a5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:16.711182 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e8575f-ff7d-4865-9763-f0c3a0e3d5a5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:16.713700 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e8575f-ff7d-4865-9763-f0c3a0e3d5a5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:16.714538 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e8575f-ff7d-4865-9763-f0c3a0e3d5a5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:16.719200 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e8575f-ff7d-4865-9763-f0c3a0e3d5a5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:16.720051 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e8575f-ff7d-4865-9763-f0c3a0e3d5a5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:16.725394 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d5e8575f-ff7d-4865-9763-f0c3a0e3d5a5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:16.853779 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:16.854560 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:16.866454 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:16.868120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:16.868572 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:16.871002 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:16.871563 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:16.872022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:16.966177 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:16.967167 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:16.968819 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:16.969574 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lazy-loading 'fault' on Instance uuid c8f9f14d-978a-4f1a-95cf-38e34758bb00 {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:04:17.407562 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:17.422798 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d5e8575f-ff7d-4865-9763-f0c3a0e3d5a5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:17.427023 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c2e8dd10-7f3e-4b00-8cd3-f351f1961b87 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 200 len: 1331 microversion: 2.1 time: 0.577797 Oct 14 18:04:17.428899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 504/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:16 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 1331 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:17.448963 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d5e8575f-ff7d-4865-9763-f0c3a0e3d5a5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.769923 Oct 14 18:04:17.452197 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 511/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:16 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:18.451864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:18.453160 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:18.461268 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:18.462020 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:18.462661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:18.463402 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:18.463937 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:18.464544 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:18.476426 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-236d88cc-b7b2-4002-8286-ca5810481a8c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:18.477712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-236d88cc-b7b2-4002-8286-ca5810481a8c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:18.480167 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 HTTP/1.1 Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:04:18.482129 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:04:18.484542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'c8f9f14d-978a-4f1a-95cf-38e34758bb00'} Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:04:18.485687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:04:18.487798 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:04:18.490170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:04:18.490170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-487977f4-3ec9-4dba-b67a-768fdfe4b951 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 404 len: 111 microversion: 2.1 time: 0.036218 Oct 14 18:04:18.490170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 505/1016] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:18 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:04:18.493267 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f2fb0756-63d1-4a7f-b53e-06b8adf4b3de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '.version_select at 0x7fe3dbf49160>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:18.494989 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-236d88cc-b7b2-4002-8286-ca5810481a8c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:18.495723 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-236d88cc-b7b2-4002-8286-ca5810481a8c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:18.496251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-236d88cc-b7b2-4002-8286-ca5810481a8c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:18.497033 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-236d88cc-b7b2-4002-8286-ca5810481a8c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:18.498454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-236d88cc-b7b2-4002-8286-ca5810481a8c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:18.498936 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-236d88cc-b7b2-4002-8286-ca5810481a8c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:18.516838 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f2fb0756-63d1-4a7f-b53e-06b8adf4b3de tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460932029" status: 202 len: 0 microversion: 2.1 time: 0.027174 Oct 14 18:04:18.517886 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 506/1017] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Oct 14 18:04:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460932029 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 18:04:18.779859 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-236d88cc-b7b2-4002-8286-ca5810481a8c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:18.789763 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-236d88cc-b7b2-4002-8286-ca5810481a8c tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.317527 Oct 14 18:04:18.790579 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 512/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:18 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:19.381440 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-b7062023-c729-45b9-b884-45bc0dc1088b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: .version_select at 0x7fe3da847670>, body: {"keypair": {"name": "tempest-keypair-438132679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIraqJ/Gp/ta9ZpILmxb6D2tdK/l5pucNECAJjvkiSN3c3TdyTk+8exV+ueY0fE7R9r/qabpL/MoZscHZDxpK+7L3mqfkGOZXQYmcnnL/5A5CS2Yjz8zFJvYQ4mOyiKng=="}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:19.399353 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-b7062023-c729-45b9-b884-45bc0dc1088b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:04:19.403680 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-b7062023-c729-45b9-b884-45bc0dc1088b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for user 3a0657648d244f12ab76c068b38e641b and project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'key_pairs'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:04:19.429071 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-b7062023-c729-45b9-b884-45bc0dc1088b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051601 Oct 14 18:04:19.436243 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 507/1019] 10.222.0.27 () {60 vars in 1159 bytes} [Fri Oct 14 18:04:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:04:19.816251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-120374c0-e47b-485f-bcc9-d42e3f9d2adb tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:19.816862 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-120374c0-e47b-485f-bcc9-d42e3f9d2adb tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:19.827006 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-120374c0-e47b-485f-bcc9-d42e3f9d2adb tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:19.827527 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-120374c0-e47b-485f-bcc9-d42e3f9d2adb tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:19.828193 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-120374c0-e47b-485f-bcc9-d42e3f9d2adb tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:19.829086 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-120374c0-e47b-485f-bcc9-d42e3f9d2adb tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:19.829700 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-120374c0-e47b-485f-bcc9-d42e3f9d2adb tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:19.830278 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-120374c0-e47b-485f-bcc9-d42e3f9d2adb tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:20.006324 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-120374c0-e47b-485f-bcc9-d42e3f9d2adb tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:20.014546 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-120374c0-e47b-485f-bcc9-d42e3f9d2adb tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.204630 Oct 14 18:04:20.017209 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 513/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:19 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:21.012930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1046683087", "imageRef": "408b8c6c-42df-43d8-997d-40a58e5c6080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2dc29fa6-a064-4dfe-be69-6fc039570894"}], "security_groups": [{"name": "tempest-securitygroup--1707253589"}], "key_name": "tempest-keypair-438132679", "user_data": "}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:21.043513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6b575412-a9c7-4d7e-9943-b98a43a34d2a tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:21.044576 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6b575412-a9c7-4d7e-9943-b98a43a34d2a tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:21.059157 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b575412-a9c7-4d7e-9943-b98a43a34d2a tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:21.059635 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b575412-a9c7-4d7e-9943-b98a43a34d2a tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:21.060115 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b575412-a9c7-4d7e-9943-b98a43a34d2a tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:21.061019 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b575412-a9c7-4d7e-9943-b98a43a34d2a tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:21.061481 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b575412-a9c7-4d7e-9943-b98a43a34d2a tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:21.062516 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b575412-a9c7-4d7e-9943-b98a43a34d2a tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:21.185954 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.network.neutron [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] validate_networks() for [('2dc29fa6-a064-4dfe-be69-6fc039570894', None, None, None, None, None)] {{(pid=118656) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 18:04:21.295737 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6b575412-a9c7-4d7e-9943-b98a43a34d2a tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:21.306506 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6b575412-a9c7-4d7e-9943-b98a43a34d2a tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.266792 Oct 14 18:04:21.307555 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 514/1021] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:21 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:04:21.652946 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Flavor limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 18:04:21.653364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Image limits 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 18:04:21.653833 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Flavor pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 18:04:21.654240 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Image pref 0:0:0 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 18:04:21.654675 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.virt.hardware [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118656) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 18:04:21.668633 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:21.669114 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:21.669549 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:21.670418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:21.670880 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:21.671834 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:21.690216 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:04:21.694973 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.quota [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Getting quotas for user 3a0657648d244f12ab76c068b38e641b and project bfdb342c57b144a384e9938fa4c6e0bf. Resources: {'cores', 'ram', 'instances'} {{(pid=118656) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:04:21.708147 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Going to run 1 instances... {{(pid=118656) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 18:04:21.710899 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='408b8c6c-42df-43d8-997d-40a58e5c6080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118656) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 18:04:21.765343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f8110450-f157-4751-954f-e37bac4032a0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.756837 Oct 14 18:04:21.775105 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 508/1022] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 18:04:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 18:04:21.781568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-49c14f75-ff86-44cb-83c2-7cfc5a3951bf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:21.782195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-49c14f75-ff86-44cb-83c2-7cfc5a3951bf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:21.845970 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-49c14f75-ff86-44cb-83c2-7cfc5a3951bf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:21.856943 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-49c14f75-ff86-44cb-83c2-7cfc5a3951bf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1241 microversion: 2.1 time: 0.079890 Oct 14 18:04:21.860385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 515/1023] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:21 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:22.332328 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-61f07899-db91-42d1-a4b1-0b53edfcf1ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:22.332902 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-61f07899-db91-42d1-a4b1-0b53edfcf1ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:22.346048 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61f07899-db91-42d1-a4b1-0b53edfcf1ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:22.346644 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61f07899-db91-42d1-a4b1-0b53edfcf1ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:22.347153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61f07899-db91-42d1-a4b1-0b53edfcf1ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:22.347989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61f07899-db91-42d1-a4b1-0b53edfcf1ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:22.348626 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61f07899-db91-42d1-a4b1-0b53edfcf1ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:22.349154 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-61f07899-db91-42d1-a4b1-0b53edfcf1ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:22.540121 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-61f07899-db91-42d1-a4b1-0b53edfcf1ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:22.559166 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-61f07899-db91-42d1-a4b1-0b53edfcf1ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.231836 Oct 14 18:04:22.559746 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 509/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:22 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:22.882139 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-2834b205-957c-4d35-beb6-99f0beaefa52 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:22.882813 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-2834b205-957c-4d35-beb6-99f0beaefa52 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:22.892696 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2834b205-957c-4d35-beb6-99f0beaefa52 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:22.893334 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2834b205-957c-4d35-beb6-99f0beaefa52 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:22.893867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2834b205-957c-4d35-beb6-99f0beaefa52 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:22.894810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2834b205-957c-4d35-beb6-99f0beaefa52 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:22.895458 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2834b205-957c-4d35-beb6-99f0beaefa52 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:22.896103 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-2834b205-957c-4d35-beb6-99f0beaefa52 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:22.900291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:22.965864 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-2834b205-957c-4d35-beb6-99f0beaefa52 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:22.976585 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-2834b205-957c-4d35-beb6-99f0beaefa52 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1293 microversion: 2.1 time: 0.098283 Oct 14 18:04:22.977549 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 516/1025] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:22 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:23.584208 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a995d9aa-ada9-46ae-8412-5c7b3e23576e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:23.585554 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a995d9aa-ada9-46ae-8412-5c7b3e23576e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:23.592772 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a995d9aa-ada9-46ae-8412-5c7b3e23576e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:23.593575 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a995d9aa-ada9-46ae-8412-5c7b3e23576e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:23.594239 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a995d9aa-ada9-46ae-8412-5c7b3e23576e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:23.595147 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a995d9aa-ada9-46ae-8412-5c7b3e23576e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:23.595819 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a995d9aa-ada9-46ae-8412-5c7b3e23576e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:23.596461 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a995d9aa-ada9-46ae-8412-5c7b3e23576e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:23.894941 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a995d9aa-ada9-46ae-8412-5c7b3e23576e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:23.902908 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a995d9aa-ada9-46ae-8412-5c7b3e23576e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.322575 Oct 14 18:04:23.903492 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 510/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:23 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:24.002041 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-fa43e990-2733-4bf7-abd7-7ba7df380030 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:24.003322 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-fa43e990-2733-4bf7-abd7-7ba7df380030 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:24.010785 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa43e990-2733-4bf7-abd7-7ba7df380030 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:24.011473 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa43e990-2733-4bf7-abd7-7ba7df380030 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:24.011914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa43e990-2733-4bf7-abd7-7ba7df380030 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:24.012809 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa43e990-2733-4bf7-abd7-7ba7df380030 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:24.013415 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa43e990-2733-4bf7-abd7-7ba7df380030 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:24.014012 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fa43e990-2733-4bf7-abd7-7ba7df380030 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:24.129180 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-fa43e990-2733-4bf7-abd7-7ba7df380030 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:24.137741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-fa43e990-2733-4bf7-abd7-7ba7df380030 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1299 microversion: 2.1 time: 0.140379 Oct 14 18:04:24.138822 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 517/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:23 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:04:24.931495 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f652274f-a1f2-48a4-8c3a-e929eea990a6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:24.932795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f652274f-a1f2-48a4-8c3a-e929eea990a6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:24.941459 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f652274f-a1f2-48a4-8c3a-e929eea990a6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:24.942265 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f652274f-a1f2-48a4-8c3a-e929eea990a6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:24.942756 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f652274f-a1f2-48a4-8c3a-e929eea990a6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:24.943677 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f652274f-a1f2-48a4-8c3a-e929eea990a6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:24.944222 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f652274f-a1f2-48a4-8c3a-e929eea990a6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:24.944710 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f652274f-a1f2-48a4-8c3a-e929eea990a6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:25.175444 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-1fccf94f-c9de-4cda-bc21-6bf4dbbcf4f6 req-9a1d938e-a96f-4bbc-b745-02e3884303f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df1fa91-20a7-43df-bb18-9fbf5222709a", "tag": "55d10375-8213-422c-94dc-809a535266c0"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:25.191012 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f652274f-a1f2-48a4-8c3a-e929eea990a6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:25.199967 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f652274f-a1f2-48a4-8c3a-e929eea990a6 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.273541 Oct 14 18:04:25.201110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 511/1028] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:24 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:25.206749 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-5053719c-33dd-4aef-8920-bc09660eb0a9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:25.207591 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-5053719c-33dd-4aef-8920-bc09660eb0a9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:25.216757 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-1fccf94f-c9de-4cda-bc21-6bf4dbbcf4f6 req-9a1d938e-a96f-4bbc-b745-02e3884303f6 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:25.217713 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-1fccf94f-c9de-4cda-bc21-6bf4dbbcf4f6 req-9a1d938e-a96f-4bbc-b745-02e3884303f6 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:25.219154 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-1fccf94f-c9de-4cda-bc21-6bf4dbbcf4f6 req-9a1d938e-a96f-4bbc-b745-02e3884303f6 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:25.228562 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5053719c-33dd-4aef-8920-bc09660eb0a9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:25.228976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5053719c-33dd-4aef-8920-bc09660eb0a9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:25.229410 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5053719c-33dd-4aef-8920-bc09660eb0a9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:25.230113 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5053719c-33dd-4aef-8920-bc09660eb0a9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:25.230641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5053719c-33dd-4aef-8920-bc09660eb0a9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:25.234400 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-5053719c-33dd-4aef-8920-bc09660eb0a9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:25.247037 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-1fccf94f-c9de-4cda-bc21-6bf4dbbcf4f6 req-9a1d938e-a96f-4bbc-b745-02e3884303f6 service nova] Creating event network-changed:55d10375-8213-422c-94dc-809a535266c0 for instance 9df1fa91-20a7-43df-bb18-9fbf5222709a on hv-cinder-74915 Oct 14 18:04:25.256233 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-1fccf94f-c9de-4cda-bc21-6bf4dbbcf4f6 req-9a1d938e-a96f-4bbc-b745-02e3884303f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089432 Oct 14 18:04:25.257840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 518/1029] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:04:25.529007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-5053719c-33dd-4aef-8920-bc09660eb0a9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:25.538359 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-5053719c-33dd-4aef-8920-bc09660eb0a9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1367 microversion: 2.1 time: 0.335966 Oct 14 18:04:25.552074 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 512/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:25 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:26.232713 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d68b8e84-805a-4059-950e-01646d42abb2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:26.233496 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d68b8e84-805a-4059-950e-01646d42abb2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:26.241254 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d68b8e84-805a-4059-950e-01646d42abb2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:26.242161 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d68b8e84-805a-4059-950e-01646d42abb2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:26.242800 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d68b8e84-805a-4059-950e-01646d42abb2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:26.243708 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d68b8e84-805a-4059-950e-01646d42abb2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:26.244282 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d68b8e84-805a-4059-950e-01646d42abb2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:26.244905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d68b8e84-805a-4059-950e-01646d42abb2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:26.413873 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d68b8e84-805a-4059-950e-01646d42abb2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:26.423484 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d68b8e84-805a-4059-950e-01646d42abb2 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.195454 Oct 14 18:04:26.424237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 519/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:26 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:04:26.565346 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-919a2b8b-ee21-4f60-a1e4-fb7c6a7949c9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:26.566123 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-919a2b8b-ee21-4f60-a1e4-fb7c6a7949c9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:26.578737 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a2b8b-ee21-4f60-a1e4-fb7c6a7949c9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:26.579951 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a2b8b-ee21-4f60-a1e4-fb7c6a7949c9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:26.580620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a2b8b-ee21-4f60-a1e4-fb7c6a7949c9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:26.581537 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a2b8b-ee21-4f60-a1e4-fb7c6a7949c9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:26.582115 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a2b8b-ee21-4f60-a1e4-fb7c6a7949c9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:26.582661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-919a2b8b-ee21-4f60-a1e4-fb7c6a7949c9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:26.960381 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-919a2b8b-ee21-4f60-a1e4-fb7c6a7949c9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:26.976115 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-919a2b8b-ee21-4f60-a1e4-fb7c6a7949c9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1367 microversion: 2.1 time: 0.416461 Oct 14 18:04:26.997272 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 513/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:26 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:27.447652 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-988b2a2a-416b-455c-b65c-a2e70c3adc11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:27.448453 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-988b2a2a-416b-455c-b65c-a2e70c3adc11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:27.457237 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-988b2a2a-416b-455c-b65c-a2e70c3adc11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:27.457716 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-988b2a2a-416b-455c-b65c-a2e70c3adc11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:27.458143 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-988b2a2a-416b-455c-b65c-a2e70c3adc11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:27.458843 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-988b2a2a-416b-455c-b65c-a2e70c3adc11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:27.459285 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-988b2a2a-416b-455c-b65c-a2e70c3adc11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:27.459702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-988b2a2a-416b-455c-b65c-a2e70c3adc11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:27.616892 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-988b2a2a-416b-455c-b65c-a2e70c3adc11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:27.625901 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-988b2a2a-416b-455c-b65c-a2e70c3adc11 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.183073 Oct 14 18:04:27.626567 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 520/1033] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:27 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:28.004237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-83c40313-4080-4db7-ab1c-917dc3ade130 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:28.005506 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-83c40313-4080-4db7-ab1c-917dc3ade130 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:28.014392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-83c40313-4080-4db7-ab1c-917dc3ade130 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:28.014392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-83c40313-4080-4db7-ab1c-917dc3ade130 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:28.014392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-83c40313-4080-4db7-ab1c-917dc3ade130 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:28.014392 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-83c40313-4080-4db7-ab1c-917dc3ade130 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:28.014913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-83c40313-4080-4db7-ab1c-917dc3ade130 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:28.016427 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-83c40313-4080-4db7-ab1c-917dc3ade130 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:28.167675 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-83c40313-4080-4db7-ab1c-917dc3ade130 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:28.177343 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-83c40313-4080-4db7-ab1c-917dc3ade130 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1367 microversion: 2.1 time: 0.178262 Oct 14 18:04:28.177951 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 514/1034] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:27 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:28.654521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f66f6318-4cfd-4930-bbb6-a4d43c8d5ea5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:28.655125 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f66f6318-4cfd-4930-bbb6-a4d43c8d5ea5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:28.662331 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f66f6318-4cfd-4930-bbb6-a4d43c8d5ea5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:28.663069 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f66f6318-4cfd-4930-bbb6-a4d43c8d5ea5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:28.663669 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f66f6318-4cfd-4930-bbb6-a4d43c8d5ea5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:28.664582 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f66f6318-4cfd-4930-bbb6-a4d43c8d5ea5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:28.665185 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f66f6318-4cfd-4930-bbb6-a4d43c8d5ea5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:28.665759 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f66f6318-4cfd-4930-bbb6-a4d43c8d5ea5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:28.744420 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-fbf75e29-e16d-49dc-9aaa-822c89821d41 req-982c8b1b-96cb-4e25-9b97-958a88502b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28431df1-6972-4ad5-b90c-c1dcb54d5a98", "name": "network-vif-plugged", "status": "completed", "tag": "f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:28.767330 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-fbf75e29-e16d-49dc-9aaa-822c89821d41 req-982c8b1b-96cb-4e25-9b97-958a88502b30 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:28.768580 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-fbf75e29-e16d-49dc-9aaa-822c89821d41 req-982c8b1b-96cb-4e25-9b97-958a88502b30 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:28.769022 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-fbf75e29-e16d-49dc-9aaa-822c89821d41 req-982c8b1b-96cb-4e25-9b97-958a88502b30 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:28.790442 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-fbf75e29-e16d-49dc-9aaa-822c89821d41 req-982c8b1b-96cb-4e25-9b97-958a88502b30 service nova] Creating event network-vif-plugged:f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf for instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 on hv-cinder-74915 Oct 14 18:04:28.817976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-fbf75e29-e16d-49dc-9aaa-822c89821d41 req-982c8b1b-96cb-4e25-9b97-958a88502b30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055353 Oct 14 18:04:28.820955 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 515/1035] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:04:28.873687 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-f66f6318-4cfd-4930-bbb6-a4d43c8d5ea5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:28.886952 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f66f6318-4cfd-4930-bbb6-a4d43c8d5ea5 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.237930 Oct 14 18:04:28.888143 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 521/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:28 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:29.201766 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2db74295-12f8-4f62-8761-d3a8aba2db6c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:29.203628 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2db74295-12f8-4f62-8761-d3a8aba2db6c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:29.209667 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2db74295-12f8-4f62-8761-d3a8aba2db6c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:29.210485 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2db74295-12f8-4f62-8761-d3a8aba2db6c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:29.211148 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2db74295-12f8-4f62-8761-d3a8aba2db6c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:29.212138 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2db74295-12f8-4f62-8761-d3a8aba2db6c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:29.212811 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2db74295-12f8-4f62-8761-d3a8aba2db6c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:29.213450 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2db74295-12f8-4f62-8761-d3a8aba2db6c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:29.369199 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2db74295-12f8-4f62-8761-d3a8aba2db6c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:29.378955 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2db74295-12f8-4f62-8761-d3a8aba2db6c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1367 microversion: 2.1 time: 0.181678 Oct 14 18:04:29.379627 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 516/1037] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:29 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:29.910592 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-65eb3c76-9b6d-4c40-89dc-9962462ae23b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:29.911803 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-65eb3c76-9b6d-4c40-89dc-9962462ae23b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:29.918943 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65eb3c76-9b6d-4c40-89dc-9962462ae23b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:29.919630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65eb3c76-9b6d-4c40-89dc-9962462ae23b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:29.920274 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65eb3c76-9b6d-4c40-89dc-9962462ae23b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:29.921151 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65eb3c76-9b6d-4c40-89dc-9962462ae23b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:29.922689 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65eb3c76-9b6d-4c40-89dc-9962462ae23b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:29.923121 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-65eb3c76-9b6d-4c40-89dc-9962462ae23b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:30.078690 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-65eb3c76-9b6d-4c40-89dc-9962462ae23b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:30.086709 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-65eb3c76-9b6d-4c40-89dc-9962462ae23b tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1573 microversion: 2.1 time: 0.180097 Oct 14 18:04:30.087585 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 522/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:29 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1573 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:30.407957 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-da097a5e-33b5-4647-8dae-937b01f5b41c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:30.409249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-da097a5e-33b5-4647-8dae-937b01f5b41c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:30.416445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da097a5e-33b5-4647-8dae-937b01f5b41c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:30.417252 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da097a5e-33b5-4647-8dae-937b01f5b41c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:30.417907 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da097a5e-33b5-4647-8dae-937b01f5b41c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:30.418839 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da097a5e-33b5-4647-8dae-937b01f5b41c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:30.419353 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da097a5e-33b5-4647-8dae-937b01f5b41c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:30.419845 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-da097a5e-33b5-4647-8dae-937b01f5b41c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:30.579364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-da097a5e-33b5-4647-8dae-937b01f5b41c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:30.591706 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-da097a5e-33b5-4647-8dae-937b01f5b41c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1367 microversion: 2.1 time: 0.188978 Oct 14 18:04:30.604724 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 517/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:30 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:30.850074 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-3c12a5ca-92c7-4790-a6d7-457de755ed5f req-3a6df34a-5acd-4c80-a5f8-3c4122ce6b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df1fa91-20a7-43df-bb18-9fbf5222709a", "name": "network-vif-plugged", "status": "completed", "tag": "55d10375-8213-422c-94dc-809a535266c0"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:30.860711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-3c12a5ca-92c7-4790-a6d7-457de755ed5f req-3a6df34a-5acd-4c80-a5f8-3c4122ce6b2d service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:30.861116 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-3c12a5ca-92c7-4790-a6d7-457de755ed5f req-3a6df34a-5acd-4c80-a5f8-3c4122ce6b2d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:30.861579 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-3c12a5ca-92c7-4790-a6d7-457de755ed5f req-3a6df34a-5acd-4c80-a5f8-3c4122ce6b2d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:30.873385 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-3c12a5ca-92c7-4790-a6d7-457de755ed5f req-3a6df34a-5acd-4c80-a5f8-3c4122ce6b2d service nova] Creating event network-vif-plugged:55d10375-8213-422c-94dc-809a535266c0 for instance 9df1fa91-20a7-43df-bb18-9fbf5222709a on hv-cinder-74915 Oct 14 18:04:30.882956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-3c12a5ca-92c7-4790-a6d7-457de755ed5f req-3a6df34a-5acd-4c80-a5f8-3c4122ce6b2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036888 Oct 14 18:04:30.883629 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 523/1040] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:04:31.111947 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d3697b04-99f3-4280-aef1-f813e32515ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:31.113130 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-d3697b04-99f3-4280-aef1-f813e32515ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:31.120491 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3697b04-99f3-4280-aef1-f813e32515ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:31.121451 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3697b04-99f3-4280-aef1-f813e32515ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:31.122132 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3697b04-99f3-4280-aef1-f813e32515ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:31.123475 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3697b04-99f3-4280-aef1-f813e32515ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:31.124567 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3697b04-99f3-4280-aef1-f813e32515ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:31.125312 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-d3697b04-99f3-4280-aef1-f813e32515ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:31.295333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-d3697b04-99f3-4280-aef1-f813e32515ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:31.306515 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d3697b04-99f3-4280-aef1-f813e32515ad tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1560 microversion: 2.1 time: 0.199632 Oct 14 18:04:31.307857 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 518/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:31 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:31.617591 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b8c3ac2d-cb89-47e5-97ba-ab75f2c654a5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:31.618368 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b8c3ac2d-cb89-47e5-97ba-ab75f2c654a5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:31.625226 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8c3ac2d-cb89-47e5-97ba-ab75f2c654a5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:31.626575 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8c3ac2d-cb89-47e5-97ba-ab75f2c654a5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:31.627184 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8c3ac2d-cb89-47e5-97ba-ab75f2c654a5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:31.628077 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8c3ac2d-cb89-47e5-97ba-ab75f2c654a5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:31.628681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8c3ac2d-cb89-47e5-97ba-ab75f2c654a5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:31.629270 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b8c3ac2d-cb89-47e5-97ba-ab75f2c654a5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:31.771107 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-b8c3ac2d-cb89-47e5-97ba-ab75f2c654a5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:31.778878 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b8c3ac2d-cb89-47e5-97ba-ab75f2c654a5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1367 microversion: 2.1 time: 0.165934 Oct 14 18:04:31.779434 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 524/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:31 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:04:32.804121 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4775f03b-0acd-4b02-aa94-3f696c5592a3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:32.805478 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4775f03b-0acd-4b02-aa94-3f696c5592a3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:32.809676 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:32.810466 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=10 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:32.816263 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4775f03b-0acd-4b02-aa94-3f696c5592a3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:32.816963 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4775f03b-0acd-4b02-aa94-3f696c5592a3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:32.817571 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4775f03b-0acd-4b02-aa94-3f696c5592a3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:32.818287 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4775f03b-0acd-4b02-aa94-3f696c5592a3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:32.818740 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4775f03b-0acd-4b02-aa94-3f696c5592a3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:32.819162 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4775f03b-0acd-4b02-aa94-3f696c5592a3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:32.962579 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-4775f03b-0acd-4b02-aa94-3f696c5592a3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:04:32.971039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4775f03b-0acd-4b02-aa94-3f696c5592a3 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1558 microversion: 2.1 time: 0.170811 Oct 14 18:04:32.971605 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 519/1043] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:04:32 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:04:32.993929 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-267294e7-439c-49f5-9397-3ef41fd92a94 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:04:32.994427 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-267294e7-439c-49f5-9397-3ef41fd92a94 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:04:32.996580 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:33.003045 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-267294e7-439c-49f5-9397-3ef41fd92a94 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:33.003530 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-267294e7-439c-49f5-9397-3ef41fd92a94 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:33.003999 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-267294e7-439c-49f5-9397-3ef41fd92a94 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:33.004705 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-267294e7-439c-49f5-9397-3ef41fd92a94 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:33.005158 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-267294e7-439c-49f5-9397-3ef41fd92a94 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:33.005582 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-267294e7-439c-49f5-9397-3ef41fd92a94 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:33.084955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-267294e7-439c-49f5-9397-3ef41fd92a94 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094770 Oct 14 18:04:33.085564 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 525/1044] 10.222.0.27 () {58 vars in 1275 bytes} [Fri Oct 14 18:04:32 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:04:34.252850 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-797a7f35-9812-45d2-8ad2-b86f3cefdf54 req-e7a07366-4ea7-4e61-b3ce-15147cfbccba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df1fa91-20a7-43df-bb18-9fbf5222709a", "tag": "55d10375-8213-422c-94dc-809a535266c0"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:04:34.263155 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-797a7f35-9812-45d2-8ad2-b86f3cefdf54 req-e7a07366-4ea7-4e61-b3ce-15147cfbccba service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:04:34.263889 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-797a7f35-9812-45d2-8ad2-b86f3cefdf54 req-e7a07366-4ea7-4e61-b3ce-15147cfbccba service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:04:34.264335 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-797a7f35-9812-45d2-8ad2-b86f3cefdf54 req-e7a07366-4ea7-4e61-b3ce-15147cfbccba service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:04:34.282407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-797a7f35-9812-45d2-8ad2-b86f3cefdf54 req-e7a07366-4ea7-4e61-b3ce-15147cfbccba service nova] Creating event network-changed:55d10375-8213-422c-94dc-809a535266c0 for instance 9df1fa91-20a7-43df-bb18-9fbf5222709a on hv-cinder-74915 Oct 14 18:04:34.288336 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-797a7f35-9812-45d2-8ad2-b86f3cefdf54 req-e7a07366-4ea7-4e61-b3ce-15147cfbccba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039206 Oct 14 18:04:34.288963 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 520/1045] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:05:12.163384 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:12.164212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=49 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:12.168568 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8567c854-67b1-4884-85b4-8d0dc3bfbc7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:12.169061 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8567c854-67b1-4884-85b4-8d0dc3bfbc7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:12.177228 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8567c854-67b1-4884-85b4-8d0dc3bfbc7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:12.177720 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8567c854-67b1-4884-85b4-8d0dc3bfbc7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:12.178157 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8567c854-67b1-4884-85b4-8d0dc3bfbc7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:12.178850 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8567c854-67b1-4884-85b4-8d0dc3bfbc7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:12.179303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8567c854-67b1-4884-85b4-8d0dc3bfbc7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:12.179726 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8567c854-67b1-4884-85b4-8d0dc3bfbc7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:12.203066 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8567c854-67b1-4884-85b4-8d0dc3bfbc7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/ips" status: 200 len: 150 microversion: 2.1 time: 0.041211 Oct 14 18:05:12.203631 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 526/1046] 10.222.0.27 () {58 vars in 1248 bytes} [Fri Oct 14 18:05:12 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:05:13.531426 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:13.532444 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=79 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:13.537672 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7230afc5-4828-4682-9b6b-42bd25a92cbf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0304b32-7a4d-46b6-8932-1c77f21cfd0c"}} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:05:13.540086 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-7230afc5-4828-4682-9b6b-42bd25a92cbf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:13.547058 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7230afc5-4828-4682-9b6b-42bd25a92cbf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:13.547530 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7230afc5-4828-4682-9b6b-42bd25a92cbf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:13.548000 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7230afc5-4828-4682-9b6b-42bd25a92cbf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:13.548679 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7230afc5-4828-4682-9b6b-42bd25a92cbf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:13.549125 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7230afc5-4828-4682-9b6b-42bd25a92cbf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:13.549542 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-7230afc5-4828-4682-9b6b-42bd25a92cbf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:14.032091 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7230afc5-4828-4682-9b6b-42bd25a92cbf tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "POST /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497078 Oct 14 18:05:14.032091 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 521/1047] 10.222.0.27 () {60 vars in 1323 bytes} [Fri Oct 14 18:05:13 2022] POST /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:05:21.805655 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1114424949", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-941379814", "security_groups": [{"name": "tempest-secgroup-smoke-804492061"}], "block_device_mapping_v2": [{"uuid": "b5aeb9da-d7ed-42d2-8be2-1d1a6cdae335", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "976baf89-2f42-4a40-b24d-859f3e36aec4"}]}} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:05:21.965649 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.network.neutron [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] validate_networks() for [('976baf89-2f42-4a40-b24d-859f3e36aec4', None, None, None, None, None)] {{(pid=118655) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 18:05:22.197547 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=4 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:22.343940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Flavor limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 18:05:22.344356 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Image limits 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 18:05:22.344820 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Flavor pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 18:05:22.345217 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Image pref 0:0:0 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 18:05:22.345624 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.virt.hardware [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 18:05:22.355403 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:22.355897 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:22.356342 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:22.357056 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:22.357500 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:22.357914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:22.374413 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Getting quotas for project 87b79c338b0047dfb68e9a5b9b16c51b. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 18:05:22.378280 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.quota [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Getting quotas for user 072cedf1a6a24f6fa7d7ed92981344dd and project 87b79c338b0047dfb68e9a5b9b16c51b. Resources: {'cores', 'ram', 'instances'} {{(pid=118655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 18:05:22.435256 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Going to run 1 instances... {{(pid=118655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 18:05:22.437670 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5aeb9da-d7ed-42d2-8be2-1d1a6cdae335',volume_size=None,volume_type=None)] {{(pid=118655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 18:05:22.577153 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3321a7a5-f5fb-4ce1-b664-6ef0e747dd05 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.775840 Oct 14 18:05:22.577800 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 527/1048] 10.222.0.27 () {60 vars in 1147 bytes} [Fri Oct 14 18:05:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 18:05:22.590475 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a592358f-e96c-4bb8-89e2-dec375a9f023 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:22.591173 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a592358f-e96c-4bb8-89e2-dec375a9f023 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:22.644355 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a592358f-e96c-4bb8-89e2-dec375a9f023 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:22.652183 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a592358f-e96c-4bb8-89e2-dec375a9f023 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1094 microversion: 2.1 time: 0.066307 Oct 14 18:05:22.652831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 522/1049] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:22 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:23.674981 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-6b42cae4-f8f5-4adb-89ad-f1f68dd21321 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:23.675594 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-6b42cae4-f8f5-4adb-89ad-f1f68dd21321 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:23.682303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b42cae4-f8f5-4adb-89ad-f1f68dd21321 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:23.682788 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b42cae4-f8f5-4adb-89ad-f1f68dd21321 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:23.683220 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b42cae4-f8f5-4adb-89ad-f1f68dd21321 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:23.683940 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b42cae4-f8f5-4adb-89ad-f1f68dd21321 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:23.684404 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b42cae4-f8f5-4adb-89ad-f1f68dd21321 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:23.684824 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-6b42cae4-f8f5-4adb-89ad-f1f68dd21321 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:23.746512 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-6b42cae4-f8f5-4adb-89ad-f1f68dd21321 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:23.754135 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-6b42cae4-f8f5-4adb-89ad-f1f68dd21321 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1192 microversion: 2.1 time: 0.083492 Oct 14 18:05:23.754813 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 528/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:23 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:23.800766 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e406c04e-a17a-4259-a099-c59360eab4d0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:23.801268 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e406c04e-a17a-4259-a099-c59360eab4d0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:23.809318 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e406c04e-a17a-4259-a099-c59360eab4d0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:23.809800 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e406c04e-a17a-4259-a099-c59360eab4d0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:23.810234 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e406c04e-a17a-4259-a099-c59360eab4d0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:23.811189 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e406c04e-a17a-4259-a099-c59360eab4d0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:23.811640 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e406c04e-a17a-4259-a099-c59360eab4d0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:23.812098 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e406c04e-a17a-4259-a099-c59360eab4d0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:23.892038 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-e406c04e-a17a-4259-a099-c59360eab4d0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lazy-loading 'services' on Instance uuid 9df1fa91-20a7-43df-bb18-9fbf5222709a {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:05:23.966952 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e406c04e-a17a-4259-a099-c59360eab4d0 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/os-volume_attachments/a0304b32-7a4d-46b6-8932-1c77f21cfd0c" status: 202 len: 0 microversion: 2.1 time: 0.169868 Oct 14 18:05:23.968645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 523/1051] 10.222.0.27 () {58 vars in 1416 bytes} [Fri Oct 14 18:05:23 2022] DELETE /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/os-volume_attachments/a0304b32-7a4d-46b6-8932-1c77f21cfd0c => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:05:23.977022 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-3e53d138-2320-4474-a441-ecca648ce827 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:23.979315 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-3e53d138-2320-4474-a441-ecca648ce827 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:23.985961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e53d138-2320-4474-a441-ecca648ce827 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:23.986454 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e53d138-2320-4474-a441-ecca648ce827 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:23.986893 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e53d138-2320-4474-a441-ecca648ce827 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:23.987972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e53d138-2320-4474-a441-ecca648ce827 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:23.988440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e53d138-2320-4474-a441-ecca648ce827 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:23.988892 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-3e53d138-2320-4474-a441-ecca648ce827 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:24.028032 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-3e53d138-2320-4474-a441-ecca648ce827 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054976 Oct 14 18:05:24.028611 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 529/1052] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:05:23 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:05:24.778692 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fc998a30-e39a-4b18-a681-1a4fc6324df0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:24.779586 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fc998a30-e39a-4b18-a681-1a4fc6324df0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:24.786649 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fc998a30-e39a-4b18-a681-1a4fc6324df0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:24.787311 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fc998a30-e39a-4b18-a681-1a4fc6324df0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:24.787750 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fc998a30-e39a-4b18-a681-1a4fc6324df0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:24.788684 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fc998a30-e39a-4b18-a681-1a4fc6324df0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:24.789308 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fc998a30-e39a-4b18-a681-1a4fc6324df0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:24.790035 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fc998a30-e39a-4b18-a681-1a4fc6324df0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:24.864776 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fc998a30-e39a-4b18-a681-1a4fc6324df0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:24.873775 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fc998a30-e39a-4b18-a681-1a4fc6324df0 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1210 microversion: 2.1 time: 0.099900 Oct 14 18:05:24.874363 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 524/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:24 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:25.040822 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-8dfc7489-7b5d-4f2c-8173-894db9bb6a75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:25.043769 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-8dfc7489-7b5d-4f2c-8173-894db9bb6a75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:25.051566 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dfc7489-7b5d-4f2c-8173-894db9bb6a75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:25.052483 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dfc7489-7b5d-4f2c-8173-894db9bb6a75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:25.053147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dfc7489-7b5d-4f2c-8173-894db9bb6a75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:25.054499 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dfc7489-7b5d-4f2c-8173-894db9bb6a75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:25.055195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dfc7489-7b5d-4f2c-8173-894db9bb6a75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:25.055869 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-8dfc7489-7b5d-4f2c-8173-894db9bb6a75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:25.088795 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-8dfc7489-7b5d-4f2c-8173-894db9bb6a75 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051847 Oct 14 18:05:25.089605 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 530/1054] 10.222.0.27 () {58 vars in 1302 bytes} [Fri Oct 14 18:05:25 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 18:05:25.160038 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-17f35771-2331-4642-ba9b-c92bf500bcab tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:25.160541 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-17f35771-2331-4642-ba9b-c92bf500bcab tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:25.167489 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17f35771-2331-4642-ba9b-c92bf500bcab tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:25.168008 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17f35771-2331-4642-ba9b-c92bf500bcab tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:25.168458 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17f35771-2331-4642-ba9b-c92bf500bcab tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:25.169161 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17f35771-2331-4642-ba9b-c92bf500bcab tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:25.169614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17f35771-2331-4642-ba9b-c92bf500bcab tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:25.170033 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-17f35771-2331-4642-ba9b-c92bf500bcab tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:25.197042 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-17f35771-2331-4642-ba9b-c92bf500bcab tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Going to try to terminate instance {{(pid=118656) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:05:25.287000 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-17f35771-2331-4642-ba9b-c92bf500bcab tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 204 len: 0 microversion: 2.1 time: 0.131371 Oct 14 18:05:25.287558 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 525/1055] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:05:25 2022] DELETE /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 18:05:25.297224 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-aedea5e6-5700-452c-ac91-860a599e3a22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:25.298366 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-aedea5e6-5700-452c-ac91-860a599e3a22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:25.305304 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aedea5e6-5700-452c-ac91-860a599e3a22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:25.305796 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aedea5e6-5700-452c-ac91-860a599e3a22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:25.306224 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aedea5e6-5700-452c-ac91-860a599e3a22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:25.307092 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aedea5e6-5700-452c-ac91-860a599e3a22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:25.307543 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aedea5e6-5700-452c-ac91-860a599e3a22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:25.307998 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-aedea5e6-5700-452c-ac91-860a599e3a22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:25.492524 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-aedea5e6-5700-452c-ac91-860a599e3a22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:25.500358 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-aedea5e6-5700-452c-ac91-860a599e3a22 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1682 microversion: 2.1 time: 0.207375 Oct 14 18:05:25.500935 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 531/1056] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:25 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:05:25.782926 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-5d543bf0-2463-4382-ac03-f1e4e07a0fb8 req-8f45236f-073f-41ab-845e-040ecfbcbcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae724fa-9da1-4b63-90be-9f20ce9cec67", "tag": "02347e31-dc6a-4aab-9546-9dc5f8f01816"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:05:25.792764 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-5d543bf0-2463-4382-ac03-f1e4e07a0fb8 req-8f45236f-073f-41ab-845e-040ecfbcbcb4 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:25.793275 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-5d543bf0-2463-4382-ac03-f1e4e07a0fb8 req-8f45236f-073f-41ab-845e-040ecfbcbcb4 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:25.793708 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-5d543bf0-2463-4382-ac03-f1e4e07a0fb8 req-8f45236f-073f-41ab-845e-040ecfbcbcb4 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:25.804446 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-5d543bf0-2463-4382-ac03-f1e4e07a0fb8 req-8f45236f-073f-41ab-845e-040ecfbcbcb4 service nova] Creating event network-changed:02347e31-dc6a-4aab-9546-9dc5f8f01816 for instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 on hv-cinder-74915 Oct 14 18:05:25.809146 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-5d543bf0-2463-4382-ac03-f1e4e07a0fb8 req-8f45236f-073f-41ab-845e-040ecfbcbcb4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030253 Oct 14 18:05:25.809727 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 526/1057] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 18:05:25.897603 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-a2fac6ce-ff44-4721-b010-de11821e966d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:25.898213 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-a2fac6ce-ff44-4721-b010-de11821e966d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:25.904164 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a2fac6ce-ff44-4721-b010-de11821e966d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:25.904650 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a2fac6ce-ff44-4721-b010-de11821e966d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:25.905088 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a2fac6ce-ff44-4721-b010-de11821e966d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:25.905779 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a2fac6ce-ff44-4721-b010-de11821e966d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:25.906231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a2fac6ce-ff44-4721-b010-de11821e966d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:25.906654 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-a2fac6ce-ff44-4721-b010-de11821e966d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:26.037117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-a2fac6ce-ff44-4721-b010-de11821e966d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:26.044748 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-a2fac6ce-ff44-4721-b010-de11821e966d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1277 microversion: 2.1 time: 0.151659 Oct 14 18:05:26.045333 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 532/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:25 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:26.526412 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-854a5080-1c2b-4276-aece-a212797aae6a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:26.527113 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-854a5080-1c2b-4276-aece-a212797aae6a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:26.533229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-854a5080-1c2b-4276-aece-a212797aae6a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:26.533709 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-854a5080-1c2b-4276-aece-a212797aae6a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:26.534149 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-854a5080-1c2b-4276-aece-a212797aae6a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:26.534830 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-854a5080-1c2b-4276-aece-a212797aae6a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:26.535284 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-854a5080-1c2b-4276-aece-a212797aae6a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:26.535709 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-854a5080-1c2b-4276-aece-a212797aae6a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:26.664173 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-854a5080-1c2b-4276-aece-a212797aae6a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:26.671795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-854a5080-1c2b-4276-aece-a212797aae6a tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1682 microversion: 2.1 time: 0.151615 Oct 14 18:05:26.672380 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 527/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:26 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:27.067573 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-fd96df4e-d6bc-4d9e-847c-962cb6b8e9c7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:27.068608 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-fd96df4e-d6bc-4d9e-847c-962cb6b8e9c7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:27.074851 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fd96df4e-d6bc-4d9e-847c-962cb6b8e9c7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:27.075328 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fd96df4e-d6bc-4d9e-847c-962cb6b8e9c7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:27.075757 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fd96df4e-d6bc-4d9e-847c-962cb6b8e9c7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:27.076483 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fd96df4e-d6bc-4d9e-847c-962cb6b8e9c7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:27.076928 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fd96df4e-d6bc-4d9e-847c-962cb6b8e9c7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:27.077349 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-fd96df4e-d6bc-4d9e-847c-962cb6b8e9c7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:27.307651 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-fd96df4e-d6bc-4d9e-847c-962cb6b8e9c7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:27.316658 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-fd96df4e-d6bc-4d9e-847c-962cb6b8e9c7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1265 microversion: 2.1 time: 0.252828 Oct 14 18:05:27.317643 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 533/1060] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:27 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:27.695508 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-e54f6931-83c9-4159-b58f-2a1b188a4d0d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:27.696169 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-e54f6931-83c9-4159-b58f-2a1b188a4d0d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:27.702516 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e54f6931-83c9-4159-b58f-2a1b188a4d0d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:27.703082 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e54f6931-83c9-4159-b58f-2a1b188a4d0d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:27.703527 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e54f6931-83c9-4159-b58f-2a1b188a4d0d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:27.704242 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e54f6931-83c9-4159-b58f-2a1b188a4d0d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:27.704716 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e54f6931-83c9-4159-b58f-2a1b188a4d0d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:27.705119 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-e54f6931-83c9-4159-b58f-2a1b188a4d0d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:27.781283 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-e54f6931-83c9-4159-b58f-2a1b188a4d0d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a0657648d244f12ab76c068b38e641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdb342c57b144a384e9938fa4c6e0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:27.789693 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-e54f6931-83c9-4159-b58f-2a1b188a4d0d tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 200 len: 1614 microversion: 2.1 time: 0.098159 Oct 14 18:05:27.790254 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 528/1061] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:27 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:28.042996 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-10097d77-9aa4-4835-85e7-a740da6d6537 req-108442e4-6beb-48cd-bd8b-6418d72f7d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df1fa91-20a7-43df-bb18-9fbf5222709a", "name": "network-vif-deleted", "tag": "55d10375-8213-422c-94dc-809a535266c0"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:05:28.054005 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-10097d77-9aa4-4835-85e7-a740da6d6537 req-108442e4-6beb-48cd-bd8b-6418d72f7d1f service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:28.054491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-10097d77-9aa4-4835-85e7-a740da6d6537 req-108442e4-6beb-48cd-bd8b-6418d72f7d1f service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:28.054932 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-10097d77-9aa4-4835-85e7-a740da6d6537 req-108442e4-6beb-48cd-bd8b-6418d72f7d1f service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:28.066959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-10097d77-9aa4-4835-85e7-a740da6d6537 req-108442e4-6beb-48cd-bd8b-6418d72f7d1f service nova] Creating event network-vif-deleted:55d10375-8213-422c-94dc-809a535266c0 for instance 9df1fa91-20a7-43df-bb18-9fbf5222709a on hv-cinder-74915 Oct 14 18:05:28.073251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-10097d77-9aa4-4835-85e7-a740da6d6537 req-108442e4-6beb-48cd-bd8b-6418d72f7d1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033962 Oct 14 18:05:28.074036 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 534/1062] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:05:28.338579 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-bb1ace57-b081-40c4-9132-5c1f106ba003 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:28.339178 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-bb1ace57-b081-40c4-9132-5c1f106ba003 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:28.345084 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bb1ace57-b081-40c4-9132-5c1f106ba003 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:28.345511 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bb1ace57-b081-40c4-9132-5c1f106ba003 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:28.345945 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bb1ace57-b081-40c4-9132-5c1f106ba003 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:28.346631 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bb1ace57-b081-40c4-9132-5c1f106ba003 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:28.347109 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bb1ace57-b081-40c4-9132-5c1f106ba003 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:28.347527 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-bb1ace57-b081-40c4-9132-5c1f106ba003 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:28.479998 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-bb1ace57-b081-40c4-9132-5c1f106ba003 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:28.487757 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-bb1ace57-b081-40c4-9132-5c1f106ba003 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1265 microversion: 2.1 time: 0.152859 Oct 14 18:05:28.488274 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 529/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:28 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:28.813747 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:28.814446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:28.820755 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:28.821275 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:28.821709 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:28.822404 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:28.822892 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:28.823314 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:28.837336 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a HTTP/1.1 Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:05:28.839291 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:28.840867 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '9df1fa91-20a7-43df-bb18-9fbf5222709a'} Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:05:28.841787 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:28.843168 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:28.844449 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:05:28.844449 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d561fc63-4ea9-4856-9d09-fcdc3fc9d24b tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 404 len: 111 microversion: 2.1 time: 0.031563 Oct 14 18:05:28.844449 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 535/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:28 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:05:28.850930 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f017f541-4971-405d-bed6-1d86fd736eb5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '.version_select at 0x7fe3daa7cb80>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:28.871767 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f017f541-4971-405d-bed6-1d86fd736eb5 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-438132679" status: 202 len: 0 microversion: 2.1 time: 0.025817 Oct 14 18:05:28.872633 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 530/1065] 10.222.0.27 () {58 vars in 1218 bytes} [Fri Oct 14 18:05:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-438132679 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:05:29.511663 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e78bb01e-5935-4613-97ba-b77b05525178 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:29.512302 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e78bb01e-5935-4613-97ba-b77b05525178 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:29.518059 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e78bb01e-5935-4613-97ba-b77b05525178 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:29.518537 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e78bb01e-5935-4613-97ba-b77b05525178 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:29.518966 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e78bb01e-5935-4613-97ba-b77b05525178 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:29.519685 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e78bb01e-5935-4613-97ba-b77b05525178 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:29.520153 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e78bb01e-5935-4613-97ba-b77b05525178 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:29.520573 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e78bb01e-5935-4613-97ba-b77b05525178 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:29.655645 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-e78bb01e-5935-4613-97ba-b77b05525178 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:29.679801 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e78bb01e-5935-4613-97ba-b77b05525178 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1265 microversion: 2.1 time: 0.172604 Oct 14 18:05:29.680410 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 536/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:29 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:30.702907 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-760365e7-ca0a-4bce-8b9d-7752e8d3236b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:30.703609 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-760365e7-ca0a-4bce-8b9d-7752e8d3236b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:30.710920 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-760365e7-ca0a-4bce-8b9d-7752e8d3236b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:30.711401 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-760365e7-ca0a-4bce-8b9d-7752e8d3236b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:30.711831 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-760365e7-ca0a-4bce-8b9d-7752e8d3236b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:30.712554 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-760365e7-ca0a-4bce-8b9d-7752e8d3236b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:30.712990 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-760365e7-ca0a-4bce-8b9d-7752e8d3236b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:30.713407 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-760365e7-ca0a-4bce-8b9d-7752e8d3236b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:30.814191 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:30.814641 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:30.821626 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:30.822116 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:30.822553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:30.823290 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:30.823772 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:30.824231 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:30.837905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: DELETE /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a HTTP/1.1 Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:05:30.839469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:30.840924 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '9df1fa91-20a7-43df-bb18-9fbf5222709a'} Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:05:30.841702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:30.842972 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:30.844303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:05:30.844303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-130f2363-5f2e-4f16-a365-7290f104c928 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 404 len: 111 microversion: 2.1 time: 0.030981 Oct 14 18:05:30.844303 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 537/1067] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:05:30 2022] DELETE /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 18:05:30.847182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-760365e7-ca0a-4bce-8b9d-7752e8d3236b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:30.849563 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:30.850175 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 9df1fa91-20a7-43df-bb18-9fbf5222709a] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:30.855773 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-760365e7-ca0a-4bce-8b9d-7752e8d3236b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1265 microversion: 2.1 time: 0.157180 Oct 14 18:05:30.856077 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:30.856383 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 531/1068] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:30 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:30.856636 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:30.856879 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:30.857498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:30.857946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:30.858368 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:30.872259 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a HTTP/1.1 Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:05:30.873773 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:30.875428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '9df1fa91-20a7-43df-bb18-9fbf5222709a'} Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:05:30.876402 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. Oct 14 18:05:30.877959 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:30.879296 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance 9df1fa91-20a7-43df-bb18-9fbf5222709a could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:05:30.879296 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-b4ec3b5e-1b21-4ede-a3b5-f3e858601832 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a" status: 404 len: 111 microversion: 2.1 time: 0.029705 Oct 14 18:05:30.879296 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 538/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:30 2022] GET /compute/v2.1/servers/9df1fa91-20a7-43df-bb18-9fbf5222709a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:05:31.879454 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fd9dd3d7-2236-44e2-8d63-f07a045a45a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:31.880092 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fd9dd3d7-2236-44e2-8d63-f07a045a45a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:31.887570 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd9dd3d7-2236-44e2-8d63-f07a045a45a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:31.888083 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd9dd3d7-2236-44e2-8d63-f07a045a45a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:31.888540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd9dd3d7-2236-44e2-8d63-f07a045a45a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:31.889223 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd9dd3d7-2236-44e2-8d63-f07a045a45a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:31.889673 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd9dd3d7-2236-44e2-8d63-f07a045a45a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:31.890092 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd9dd3d7-2236-44e2-8d63-f07a045a45a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:32.013909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:32.014431 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:32.017925 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-fd9dd3d7-2236-44e2-8d63-f07a045a45a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:32.020734 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:32.021212 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:32.021647 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:32.022338 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:32.022827 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:32.023250 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:32.026077 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fd9dd3d7-2236-44e2-8d63-f07a045a45a4 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1265 microversion: 2.1 time: 0.150521 Oct 14 18:05:32.026843 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 532/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:31 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:32.037852 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: DELETE /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 HTTP/1.1 Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:05:32.039498 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:05:32.041255 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'c8f9f14d-978a-4f1a-95cf-38e34758bb00'} Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:05:32.042085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:05:32.043377 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.044729 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:05:32.044729 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-dc0d2410-83be-47ad-8c27-c1d32a47b618 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 404 len: 111 microversion: 2.1 time: 0.030798 Oct 14 18:05:32.044729 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 539/1071] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:05:32 2022] DELETE /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 18:05:32.049193 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:32.049795 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: c8f9f14d-978a-4f1a-95cf-38e34758bb00] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:32.056534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:32.056994 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:32.057425 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:32.058108 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:32.058556 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:32.058975 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:32.073005 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 HTTP/1.1 Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:05:32.074620 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:05:32.076282 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'c8f9f14d-978a-4f1a-95cf-38e34758bb00'} Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:05:32.077110 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. Oct 14 18:05:32.078390 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.079534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance c8f9f14d-978a-4f1a-95cf-38e34758bb00 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:05:32.079534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-97b2e77f-61aa-4114-8391-3b541e32be7c tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00" status: 404 len: 111 microversion: 2.1 time: 0.030467 Oct 14 18:05:32.079534 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 533/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:32 2022] GET /compute/v2.1/servers/c8f9f14d-978a-4f1a-95cf-38e34758bb00 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 18:05:32.084434 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:32.084952 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:32.090749 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:32.091225 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:32.091653 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:32.092364 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:32.092840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:32.093256 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:32.106155 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: DELETE /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 HTTP/1.1 Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:05:32.107665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:05:32.109286 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'caefe50f-f313-490e-9dcc-5c6715233c61'} Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:05:32.110195 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:05:32.111765 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.113612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:05:32.113612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-84412389-4bcc-47ae-9498-fa1ba8eaada9 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 404 len: 111 microversion: 2.1 time: 0.028453 Oct 14 18:05:32.113612 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 540/1073] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:05:32 2022] DELETE /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:05:32.117746 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:32.118352 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: caefe50f-f313-490e-9dcc-5c6715233c61] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:32.124214 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:32.124690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:32.125120 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:32.125800 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:32.126245 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:32.126661 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:32.140394 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 HTTP/1.1 Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:05:32.141820 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:05:32.143462 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'caefe50f-f313-490e-9dcc-5c6715233c61'} Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:05:32.144290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. Oct 14 18:05:32.145536 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:32.147013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance caefe50f-f313-490e-9dcc-5c6715233c61 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:05:32.147013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-c8f31f82-e596-4cf9-b4e8-882cc2f80532 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61" status: 404 len: 111 microversion: 2.1 time: 0.029787 Oct 14 18:05:32.147013 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 534/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:32 2022] GET /compute/v2.1/servers/caefe50f-f313-490e-9dcc-5c6715233c61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:05:33.048738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-cd1bed1e-6f69-4a7a-975c-995c34f9b4bc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:33.049346 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-cd1bed1e-6f69-4a7a-975c-995c34f9b4bc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:33.051289 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=2 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:33.051983 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell0:SELECT=6 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:33.058714 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cd1bed1e-6f69-4a7a-975c-995c34f9b4bc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:33.059198 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cd1bed1e-6f69-4a7a-975c-995c34f9b4bc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:33.059630 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cd1bed1e-6f69-4a7a-975c-995c34f9b4bc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:33.060353 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cd1bed1e-6f69-4a7a-975c-995c34f9b4bc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:33.060806 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cd1bed1e-6f69-4a7a-975c-995c34f9b4bc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:33.061487 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-cd1bed1e-6f69-4a7a-975c-995c34f9b4bc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:33.192163 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-cd1bed1e-6f69-4a7a-975c-995c34f9b4bc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:33.199956 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-cd1bed1e-6f69-4a7a-975c-995c34f9b4bc tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1265 microversion: 2.1 time: 0.155069 Oct 14 18:05:33.200514 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 541/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:33 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:33.279259 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:33.279754 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:33.281670 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell0:SELECT=2 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:33.287903 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:33.288937 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:33.289475 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:33.290102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:33.290748 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:33.291038 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:33.309029 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: DELETE /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 HTTP/1.1 Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:05:33.310614 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:05:33.312538 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': '8bbbe808-1a08-42f9-b3eb-101761f16451'} Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:05:33.313445 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:05:33.315007 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:05:33.316528 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:05:33.316528 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-feb88f1f-3c5f-4397-b04e-bfd2d5277357 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 404 len: 111 microversion: 2.1 time: 0.036820 Oct 14 18:05:33.316528 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 535/1076] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:05:33 2022] DELETE /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:05:33.322068 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:33.322681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] [instance: 8bbbe808-1a08-42f9-b3eb-101761f16451] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:33.328914 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:33.329395 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:33.329834 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:33.330525 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:33.330981 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:33.331410 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:33.345380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] HTTP exception thrown: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Request method failure captured: Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 HTTP/1.1 Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaO91VeUGktqD2lCiElxcZnZMihxTys8kermC0GpDKHODJe-cOBpapIPvoOhvqbDODLVMYRf3TZeEqEo0WGhwOCT8rP9UvV4_PCKAKgSy4knWXaBurb-sjfHAHqgM9K3Sf3r3v_4pLSjwbg1-Ek7xHPyNrztHMpcb-z9RrZ7gPglTpE Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:05:33.346964 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfdb342c57b144a384e9938fa4c6e0bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfdb342c57b144a384e9938fa4c6e0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: bfdb342c57b144a384e9938fa4c6e0bf Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1693788931 Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 3a0657648d244f12ab76c068b38e641b Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-AttachVolumeNegativeTest-1693788931-project Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:05:33.348741 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '8bbbe808-1a08-42f9-b3eb-101761f16451'} Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:05:33.349553 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. Oct 14 18:05:33.351738 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:33.353573 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] Returning 404 to user: Instance 8bbbe808-1a08-42f9-b3eb-101761f16451 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:05:33.353573 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-f43c7b17-14b2-4252-a2dc-9262a3077937 tempest-AttachVolumeNegativeTest-1693788931 tempest-AttachVolumeNegativeTest-1693788931-project] 10.222.0.27 "GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451" status: 404 len: 111 microversion: 2.1 time: 0.030209 Oct 14 18:05:33.353573 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 542/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:33 2022] GET /compute/v2.1/servers/8bbbe808-1a08-42f9-b3eb-101761f16451 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:05:34.222388 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-a2fb4988-b107-4e54-b376-f066b14e78ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:34.223336 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-a2fb4988-b107-4e54-b376-f066b14e78ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:34.231049 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2fb4988-b107-4e54-b376-f066b14e78ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:34.231540 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2fb4988-b107-4e54-b376-f066b14e78ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:34.232027 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2fb4988-b107-4e54-b376-f066b14e78ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:34.232732 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2fb4988-b107-4e54-b376-f066b14e78ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:34.233192 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2fb4988-b107-4e54-b376-f066b14e78ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:34.233621 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-a2fb4988-b107-4e54-b376-f066b14e78ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:34.375229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-a2fb4988-b107-4e54-b376-f066b14e78ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:34.383822 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-a2fb4988-b107-4e54-b376-f066b14e78ed tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1265 microversion: 2.1 time: 0.165510 Oct 14 18:05:34.384424 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 536/1078] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:34 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:35.406599 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d97f3d7b-ae84-459e-8cc4-6774fdc2c50f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:35.407202 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d97f3d7b-ae84-459e-8cc4-6774fdc2c50f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:35.414753 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d97f3d7b-ae84-459e-8cc4-6774fdc2c50f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:35.415440 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d97f3d7b-ae84-459e-8cc4-6774fdc2c50f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:35.416076 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d97f3d7b-ae84-459e-8cc4-6774fdc2c50f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:35.416935 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d97f3d7b-ae84-459e-8cc4-6774fdc2c50f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:35.417380 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d97f3d7b-ae84-459e-8cc4-6774fdc2c50f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:35.417965 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d97f3d7b-ae84-459e-8cc4-6774fdc2c50f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:35.557370 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d97f3d7b-ae84-459e-8cc4-6774fdc2c50f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:35.566358 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d97f3d7b-ae84-459e-8cc4-6774fdc2c50f tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1265 microversion: 2.1 time: 0.163351 Oct 14 18:05:35.566775 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 543/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:35 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:36.593685 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-f6f454d7-67d9-4570-8d04-37f65fe9970a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:36.597396 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-f6f454d7-67d9-4570-8d04-37f65fe9970a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:36.615641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6f454d7-67d9-4570-8d04-37f65fe9970a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:36.617021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6f454d7-67d9-4570-8d04-37f65fe9970a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:36.618760 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6f454d7-67d9-4570-8d04-37f65fe9970a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:36.619833 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6f454d7-67d9-4570-8d04-37f65fe9970a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:36.622501 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6f454d7-67d9-4570-8d04-37f65fe9970a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:36.622501 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-f6f454d7-67d9-4570-8d04-37f65fe9970a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:36.844988 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-f6f454d7-67d9-4570-8d04-37f65fe9970a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:36.855057 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-f6f454d7-67d9-4570-8d04-37f65fe9970a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1265 microversion: 2.1 time: 0.269059 Oct 14 18:05:36.855909 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 537/1080] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:36 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:36.947282 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-bd49c667-a947-4b03-84e5-603f363b312e req-6ecfbd8e-6210-4402-a886-c13048ebc321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae724fa-9da1-4b63-90be-9f20ce9cec67", "name": "network-vif-plugged", "status": "completed", "tag": "02347e31-dc6a-4aab-9546-9dc5f8f01816"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:05:36.959900 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-bd49c667-a947-4b03-84e5-603f363b312e req-6ecfbd8e-6210-4402-a886-c13048ebc321 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:36.960754 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-bd49c667-a947-4b03-84e5-603f363b312e req-6ecfbd8e-6210-4402-a886-c13048ebc321 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:36.961836 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-bd49c667-a947-4b03-84e5-603f363b312e req-6ecfbd8e-6210-4402-a886-c13048ebc321 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:36.978472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-bd49c667-a947-4b03-84e5-603f363b312e req-6ecfbd8e-6210-4402-a886-c13048ebc321 service nova] Creating event network-vif-plugged:02347e31-dc6a-4aab-9546-9dc5f8f01816 for instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 on hv-cinder-74915 Oct 14 18:05:36.983806 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-bd49c667-a947-4b03-84e5-603f363b312e req-6ecfbd8e-6210-4402-a886-c13048ebc321 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041683 Oct 14 18:05:36.985056 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 544/1081] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:05:37.878286 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-6acb9efe-2818-4e62-b35e-7c3605b9713d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:37.878897 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-6acb9efe-2818-4e62-b35e-7c3605b9713d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:37.886146 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6acb9efe-2818-4e62-b35e-7c3605b9713d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:37.886635 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6acb9efe-2818-4e62-b35e-7c3605b9713d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:37.887073 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6acb9efe-2818-4e62-b35e-7c3605b9713d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:37.887767 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6acb9efe-2818-4e62-b35e-7c3605b9713d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:37.888253 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6acb9efe-2818-4e62-b35e-7c3605b9713d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:37.888675 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-6acb9efe-2818-4e62-b35e-7c3605b9713d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:37.906816 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:38.028507 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-6acb9efe-2818-4e62-b35e-7c3605b9713d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:38.036174 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-6acb9efe-2818-4e62-b35e-7c3605b9713d tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1265 microversion: 2.1 time: 0.161737 Oct 14 18:05:38.036729 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 538/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:37 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:39.061047 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-d3155783-2bb5-4340-b040-d67fca4518b2 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:39.062010 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-d3155783-2bb5-4340-b040-d67fca4518b2 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:39.068625 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3155783-2bb5-4340-b040-d67fca4518b2 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:39.069093 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3155783-2bb5-4340-b040-d67fca4518b2 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:39.069518 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3155783-2bb5-4340-b040-d67fca4518b2 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:39.070308 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3155783-2bb5-4340-b040-d67fca4518b2 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:39.070756 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3155783-2bb5-4340-b040-d67fca4518b2 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:39.071175 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-d3155783-2bb5-4340-b040-d67fca4518b2 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:39.203938 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-d3155783-2bb5-4340-b040-d67fca4518b2 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:39.211761 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-d3155783-2bb5-4340-b040-d67fca4518b2 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1452 microversion: 2.1 time: 0.154902 Oct 14 18:05:39.212341 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 545/1083] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:39 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:39.233891 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2e437b7e-9243-4a44-814e-21fe549c82f5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:39.234500 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2e437b7e-9243-4a44-814e-21fe549c82f5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:39.240914 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2e437b7e-9243-4a44-814e-21fe549c82f5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:39.241394 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2e437b7e-9243-4a44-814e-21fe549c82f5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:39.242513 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2e437b7e-9243-4a44-814e-21fe549c82f5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:39.243232 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2e437b7e-9243-4a44-814e-21fe549c82f5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:39.243687 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2e437b7e-9243-4a44-814e-21fe549c82f5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:39.244134 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2e437b7e-9243-4a44-814e-21fe549c82f5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:39.648645 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2e437b7e-9243-4a44-814e-21fe549c82f5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:39.656326 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2e437b7e-9243-4a44-814e-21fe549c82f5 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1452 microversion: 2.1 time: 0.426239 Oct 14 18:05:39.656901 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 539/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:39 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1452 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:41.409427 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-88596770-a691-4f67-a91c-7323b5dc5ebe req-59b16ca2-8a04-4158-8b59-be7774a5dd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae724fa-9da1-4b63-90be-9f20ce9cec67", "tag": "02347e31-dc6a-4aab-9546-9dc5f8f01816"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:05:41.419909 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-88596770-a691-4f67-a91c-7323b5dc5ebe req-59b16ca2-8a04-4158-8b59-be7774a5dd3d service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:41.420491 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-88596770-a691-4f67-a91c-7323b5dc5ebe req-59b16ca2-8a04-4158-8b59-be7774a5dd3d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:41.420988 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-88596770-a691-4f67-a91c-7323b5dc5ebe req-59b16ca2-8a04-4158-8b59-be7774a5dd3d service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:41.432611 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-88596770-a691-4f67-a91c-7323b5dc5ebe req-59b16ca2-8a04-4158-8b59-be7774a5dd3d service nova] Creating event network-changed:02347e31-dc6a-4aab-9546-9dc5f8f01816 for instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 on hv-cinder-74915 Oct 14 18:05:41.437903 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-88596770-a691-4f67-a91c-7323b5dc5ebe req-59b16ca2-8a04-4158-8b59-be7774a5dd3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032159 Oct 14 18:05:41.438729 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 546/1085] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:05:50.819510 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4fac1a29-67af-485f-85b2-4ef4cca8b64e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:50.820095 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4fac1a29-67af-485f-85b2-4ef4cca8b64e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:50.823565 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:50.824239 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=8 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:50.824550 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-c18ddab3-669b-4fef-9444-63d076efd688 req-2f11ef06-4151-4a4f-b05e-462fb37b8761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28431df1-6972-4ad5-b90c-c1dcb54d5a98", "tag": "f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:05:50.831009 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4fac1a29-67af-485f-85b2-4ef4cca8b64e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:50.831545 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4fac1a29-67af-485f-85b2-4ef4cca8b64e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:50.832215 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4fac1a29-67af-485f-85b2-4ef4cca8b64e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:50.833157 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4fac1a29-67af-485f-85b2-4ef4cca8b64e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:50.833712 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4fac1a29-67af-485f-85b2-4ef4cca8b64e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:50.834263 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:50.834418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4fac1a29-67af-485f-85b2-4ef4cca8b64e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:50.836405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-c18ddab3-669b-4fef-9444-63d076efd688 req-2f11ef06-4151-4a4f-b05e-462fb37b8761 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:50.836880 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-c18ddab3-669b-4fef-9444-63d076efd688 req-2f11ef06-4151-4a4f-b05e-462fb37b8761 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:50.837482 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-c18ddab3-669b-4fef-9444-63d076efd688 req-2f11ef06-4151-4a4f-b05e-462fb37b8761 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:50.850365 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-c18ddab3-669b-4fef-9444-63d076efd688 req-2f11ef06-4151-4a4f-b05e-462fb37b8761 service nova] Creating event network-changed:f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf for instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 on hv-cinder-74915 Oct 14 18:05:50.855603 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-c18ddab3-669b-4fef-9444-63d076efd688 req-2f11ef06-4151-4a4f-b05e-462fb37b8761 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036927 Oct 14 18:05:50.856251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 547/1086] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:05:50.865374 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4fac1a29-67af-485f-85b2-4ef4cca8b64e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Going to try to terminate instance {{(pid=118656) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:05:50.958137 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4fac1a29-67af-485f-85b2-4ef4cca8b64e tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "DELETE /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 204 len: 0 microversion: 2.1 time: 0.142246 Oct 14 18:05:50.958834 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 540/1087] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:05:50 2022] DELETE /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:05:50.968522 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-5d84fcdf-b3fd-42fa-891b-7bb274c9efcd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:50.969302 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-5d84fcdf-b3fd-42fa-891b-7bb274c9efcd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:50.987444 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5d84fcdf-b3fd-42fa-891b-7bb274c9efcd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:50.988284 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5d84fcdf-b3fd-42fa-891b-7bb274c9efcd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:50.988714 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5d84fcdf-b3fd-42fa-891b-7bb274c9efcd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:50.989405 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5d84fcdf-b3fd-42fa-891b-7bb274c9efcd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:50.989857 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5d84fcdf-b3fd-42fa-891b-7bb274c9efcd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:50.990276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-5d84fcdf-b3fd-42fa-891b-7bb274c9efcd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:51.127510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-5d84fcdf-b3fd-42fa-891b-7bb274c9efcd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:51.137712 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-5d84fcdf-b3fd-42fa-891b-7bb274c9efcd tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.173463 Oct 14 18:05:51.138492 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 548/1088] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:50 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:05:52.163313 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-3a910736-3344-4635-a707-5d48de9dbd01 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:52.164182 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-3a910736-3344-4635-a707-5d48de9dbd01 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:52.171519 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a910736-3344-4635-a707-5d48de9dbd01 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:52.172057 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a910736-3344-4635-a707-5d48de9dbd01 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:52.172492 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a910736-3344-4635-a707-5d48de9dbd01 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:52.173188 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a910736-3344-4635-a707-5d48de9dbd01 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:52.173640 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a910736-3344-4635-a707-5d48de9dbd01 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:52.174060 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-3a910736-3344-4635-a707-5d48de9dbd01 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:52.334956 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-3a910736-3344-4635-a707-5d48de9dbd01 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:52.343702 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-3a910736-3344-4635-a707-5d48de9dbd01 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1566 microversion: 2.1 time: 0.185452 Oct 14 18:05:52.345775 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 541/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:52 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:53.230037 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-e6cbc095-2417-48fc-98e6-b4694be2a6ad req-e22cf3ae-b3c9-4bdd-908d-135e05d9a729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28431df1-6972-4ad5-b90c-c1dcb54d5a98", "name": "network-vif-deleted", "tag": "f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:05:53.237510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e6cbc095-2417-48fc-98e6-b4694be2a6ad req-e22cf3ae-b3c9-4bdd-908d-135e05d9a729 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:53.237988 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e6cbc095-2417-48fc-98e6-b4694be2a6ad req-e22cf3ae-b3c9-4bdd-908d-135e05d9a729 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:53.238414 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e6cbc095-2417-48fc-98e6-b4694be2a6ad req-e22cf3ae-b3c9-4bdd-908d-135e05d9a729 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:53.242147 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=89 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:53.250423 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-e6cbc095-2417-48fc-98e6-b4694be2a6ad req-e22cf3ae-b3c9-4bdd-908d-135e05d9a729 service nova] Creating event network-vif-deleted:f4f814dd-6b82-42d6-be3f-19a2e4d7ebdf for instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 on hv-cinder-74915 Oct 14 18:05:53.255207 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-e6cbc095-2417-48fc-98e6-b4694be2a6ad req-e22cf3ae-b3c9-4bdd-908d-135e05d9a729 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163722 Oct 14 18:05:53.256052 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 549/1090] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:05:53.370764 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-4e2a7094-5ea7-44cb-b115-58191cb79dce tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:53.375765 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-4e2a7094-5ea7-44cb-b115-58191cb79dce tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:53.382021 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e2a7094-5ea7-44cb-b115-58191cb79dce tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:53.382460 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e2a7094-5ea7-44cb-b115-58191cb79dce tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:53.382889 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e2a7094-5ea7-44cb-b115-58191cb79dce tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:53.383594 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e2a7094-5ea7-44cb-b115-58191cb79dce tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:53.384662 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e2a7094-5ea7-44cb-b115-58191cb79dce tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:53.385207 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-4e2a7094-5ea7-44cb-b115-58191cb79dce tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:53.468199 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-4e2a7094-5ea7-44cb-b115-58191cb79dce tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74943fd4c96b43e8a32989e7ed74cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16610892c7d34b28a2ee5313a4bea23b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:05:53.484264 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-4e2a7094-5ea7-44cb-b115-58191cb79dce tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 200 len: 1218 microversion: 2.1 time: 0.114280 Oct 14 18:05:53.486096 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 542/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:53 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:05:54.510478 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:54.511182 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] [instance: 28431df1-6972-4ad5-b90c-c1dcb54d5a98] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:05:54.519384 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:54.519885 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:54.520332 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:54.521035 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:05:54.521489 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:05:54.521917 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:05:54.544815 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] HTTP exception thrown: Instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 could not be found. Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Request method failure captured: Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 HTTP/1.1 Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaPH5yE7yRqvr-nZaLN4D0yS7NeAajX4rfgl2zEjTVnEG5aVkHNP5gYkFIS_ruhIEbQZs-b2gkG0d2lcsL4yCfDr-YLZQGWiQr5ZD5BCwxB2CHmbX8duQTm9Kqq0XLfbXVtht2pR1xkIWmhQwiuHP5dnbr_FFMzhKPmC50CvHZWwy1g Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 16610892c7d34b28a2ee5313a4bea23b Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-TestShelveInstance-1598812418 Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:05:54.546469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16610892c7d34b28a2ee5313a4bea23b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16610892c7d34b28a2ee5313a4bea23b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16610892c7d34b28a2ee5313a4bea23b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16610892c7d34b28a2ee5313a4bea23b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-TestShelveInstance-1598812418 Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 16610892c7d34b28a2ee5313a4bea23b Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-TestShelveInstance-1598812418 Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-TestShelveInstance-1598812418-project Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 74943fd4c96b43e8a32989e7ed74cdf2 Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-TestShelveInstance-1598812418-project Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 could not be found. Oct 14 18:05:54.548030 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '28431df1-6972-4ad5-b90c-c1dcb54d5a98'} Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 could not be found. Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:05:54.548946 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 could not be found. Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 could not be found. Oct 14 18:05:54.550276 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:05:54.551446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Returning 404 to user: Instance 28431df1-6972-4ad5-b90c-c1dcb54d5a98 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:05:54.551446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-446cf871-5e39-4c5f-a8c8-c93fd3b9e9d4 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98" status: 404 len: 111 microversion: 2.1 time: 0.042782 Oct 14 18:05:54.551446 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 550/1092] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:05:54 2022] GET /compute/v2.1/servers/28431df1-6972-4ad5-b90c-c1dcb54d5a98 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:05:54.788478 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-d23bcec1-f802-41cc-8c88-f6ac06693980 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] Calling method '.version_select at 0x7fe3da7df9d0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:05:54.813103 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-d23bcec1-f802-41cc-8c88-f6ac06693980 tempest-TestShelveInstance-1598812418 tempest-TestShelveInstance-1598812418-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-319776221" status: 202 len: 0 microversion: 2.1 time: 0.028345 Oct 14 18:05:54.813800 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 543/1093] 10.222.0.27 () {58 vars in 1251 bytes} [Fri Oct 14 18:05:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-319776221 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 18:07:33.675537 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dcb4160e-01a0-47aa-8215-face1e0c5a22] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 14 18:07:33.676162 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:07:33.676967 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG dbcounter [-] [118656] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:07:33.678026 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR oslo.messaging._drivers.impl_rabbit [-] [80ce215f-6634-4806-a36d-bb63ee41db38] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 14 18:07:33.678948 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_api:SELECT=7 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:07:33.679786 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG dbcounter [-] [118655] Writing DB stats nova_cell1:SELECT=3 {{(pid=118655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:07:33.682678 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 18:07:33.682678 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Fri Oct 14 18:07:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 14 18:07:33.684343 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 14 18:07:33.684510 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Fri Oct 14 18:07:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 (ip 10.222.0.27) !!! Oct 14 18:07:33.693476 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-bf57254b-a595-433e-9bd0-0cdc65c4eae1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:33.693976 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bf57254b-a595-433e-9bd0-0cdc65c4eae1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:33.707121 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-c8e5580e-0194-481a-9cea-a31ef1644e18 req-faca869f-3111-49cf-9bce-9b9967123673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae724fa-9da1-4b63-90be-9f20ce9cec67", "tag": "02347e31-dc6a-4aab-9546-9dc5f8f01816"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:07:33.710943 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf57254b-a595-433e-9bd0-0cdc65c4eae1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:33.711444 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf57254b-a595-433e-9bd0-0cdc65c4eae1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:33.711897 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf57254b-a595-433e-9bd0-0cdc65c4eae1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:33.712627 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf57254b-a595-433e-9bd0-0cdc65c4eae1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:33.713288 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf57254b-a595-433e-9bd0-0cdc65c4eae1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:33.713512 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-bf57254b-a595-433e-9bd0-0cdc65c4eae1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:33.723173 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-c8e5580e-0194-481a-9cea-a31ef1644e18 req-faca869f-3111-49cf-9bce-9b9967123673 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:33.723657 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-c8e5580e-0194-481a-9cea-a31ef1644e18 req-faca869f-3111-49cf-9bce-9b9967123673 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:33.724153 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-c8e5580e-0194-481a-9cea-a31ef1644e18 req-faca869f-3111-49cf-9bce-9b9967123673 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:33.735848 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-c8e5580e-0194-481a-9cea-a31ef1644e18 req-faca869f-3111-49cf-9bce-9b9967123673 service nova] Creating event network-changed:02347e31-dc6a-4aab-9546-9dc5f8f01816 for instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 on hv-cinder-74915 Oct 14 18:07:33.741285 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-c8e5580e-0194-481a-9cea-a31ef1644e18 req-faca869f-3111-49cf-9bce-9b9967123673 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069876 Oct 14 18:07:33.742229 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 544/1094] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:07:33.743480 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-bf57254b-a595-433e-9bd0-0cdc65c4eae1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Going to try to terminate instance {{(pid=118655) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:07:33.833975 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-bf57254b-a595-433e-9bd0-0cdc65c4eae1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 204 len: 0 microversion: 2.1 time: 0.165106 Oct 14 18:07:33.834931 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 551/1095] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:07:33 2022] DELETE /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:07:33.844747 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-dcb836b2-a5c0-49ce-9652-cebeee40df26 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:33.845484 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-dcb836b2-a5c0-49ce-9652-cebeee40df26 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:33.852596 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dcb836b2-a5c0-49ce-9652-cebeee40df26 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:33.853086 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dcb836b2-a5c0-49ce-9652-cebeee40df26 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:33.853690 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dcb836b2-a5c0-49ce-9652-cebeee40df26 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:33.855112 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dcb836b2-a5c0-49ce-9652-cebeee40df26 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:33.855585 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dcb836b2-a5c0-49ce-9652-cebeee40df26 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:33.856046 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-dcb836b2-a5c0-49ce-9652-cebeee40df26 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:33.996345 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-dcb836b2-a5c0-49ce-9652-cebeee40df26 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:07:34.004342 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-dcb836b2-a5c0-49ce-9652-cebeee40df26 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1577 microversion: 2.1 time: 0.164299 Oct 14 18:07:34.004921 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 545/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:07:33 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:07:35.028091 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ab1988a1-06be-487e-b81b-1a1c5218eb58 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:35.028705 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ab1988a1-06be-487e-b81b-1a1c5218eb58 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:35.036955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab1988a1-06be-487e-b81b-1a1c5218eb58 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:35.037428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab1988a1-06be-487e-b81b-1a1c5218eb58 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:35.037855 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab1988a1-06be-487e-b81b-1a1c5218eb58 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:35.038536 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab1988a1-06be-487e-b81b-1a1c5218eb58 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:35.038980 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab1988a1-06be-487e-b81b-1a1c5218eb58 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:35.039394 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab1988a1-06be-487e-b81b-1a1c5218eb58 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:35.045279 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO oslo.messaging._drivers.impl_rabbit [-] [80ce215f-6634-4806-a36d-bb63ee41db38] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45862. Oct 14 18:07:35.169418 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ab1988a1-06be-487e-b81b-1a1c5218eb58 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:07:35.177369 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ab1988a1-06be-487e-b81b-1a1c5218eb58 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1577 microversion: 2.1 time: 0.153632 Oct 14 18:07:35.177923 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 552/1097] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:07:35 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:07:36.126212 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO oslo.messaging._drivers.impl_rabbit [-] [dcb4160e-01a0-47aa-8215-face1e0c5a22] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45868. Oct 14 18:07:36.200352 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-ab576c4c-77da-4dae-ba03-5195b9846c39 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:36.201094 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-ab576c4c-77da-4dae-ba03-5195b9846c39 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:36.208124 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab576c4c-77da-4dae-ba03-5195b9846c39 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:36.208685 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab576c4c-77da-4dae-ba03-5195b9846c39 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:36.209208 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab576c4c-77da-4dae-ba03-5195b9846c39 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:36.209810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab576c4c-77da-4dae-ba03-5195b9846c39 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:36.210263 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab576c4c-77da-4dae-ba03-5195b9846c39 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:36.210693 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-ab576c4c-77da-4dae-ba03-5195b9846c39 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:36.272818 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-ab576c4c-77da-4dae-ba03-5195b9846c39 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:07:36.280957 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-ab576c4c-77da-4dae-ba03-5195b9846c39 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 200 len: 1225 microversion: 2.1 time: 0.084430 Oct 14 18:07:36.281513 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 553/1098] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:07:36 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 18:07:36.309418 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [req-a6e9bf7d-b78c-4dab-83b4-c9d50baa85c3 req-f79a55f4-102a-4b9f-b11b-132b3f40e370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae724fa-9da1-4b63-90be-9f20ce9cec67", "name": "network-vif-deleted", "tag": "02347e31-dc6a-4aab-9546-9dc5f8f01816"}]} {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:07:36.319411 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-a6e9bf7d-b78c-4dab-83b4-c9d50baa85c3 req-f79a55f4-102a-4b9f-b11b-132b3f40e370 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:36.319825 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-a6e9bf7d-b78c-4dab-83b4-c9d50baa85c3 req-f79a55f4-102a-4b9f-b11b-132b3f40e370 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:36.320285 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [req-a6e9bf7d-b78c-4dab-83b4-c9d50baa85c3 req-f79a55f4-102a-4b9f-b11b-132b3f40e370 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:36.331979 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.compute.server_external_events [req-a6e9bf7d-b78c-4dab-83b4-c9d50baa85c3 req-f79a55f4-102a-4b9f-b11b-132b3f40e370 service nova] Creating event network-vif-deleted:02347e31-dc6a-4aab-9546-9dc5f8f01816 for instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 on hv-cinder-74915 Oct 14 18:07:36.336920 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [req-a6e9bf7d-b78c-4dab-83b4-c9d50baa85c3 req-f79a55f4-102a-4b9f-b11b-132b3f40e370 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223456 Oct 14 18:07:36.337600 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 546/1099] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:07:37.303264 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:37.303918 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 6ae724fa-9da1-4b63-90be-9f20ce9cec67] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:37.310761 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:37.311243 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:37.311670 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:37.312378 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:37.312826 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:37.313582 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:37.326798 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] HTTP exception thrown: Instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 could not be found. Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Request method failure captured: Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 HTTP/1.1 Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaOZWpQaGp62BSIfkx4qhavceRUH_o-jNYVY8yp9OQSx3hBLFcCHv6IiI0NVNAn9uZnnSYjBB1eaYKelB0GnwtmzwKvipA4KmzlzM3salbGlEXZwLHIHtW-bSAmTkoUfSSZ7509FMKTfbPygcxsZkOpDnAznE4tSoZS4yhhj98XQ-po Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 87b79c338b0047dfb68e9a5b9b16c51b Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:07:37.328443 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87b79c338b0047dfb68e9a5b9b16c51b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 87b79c338b0047dfb68e9a5b9b16c51b Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-TestVolumeBootPattern-229576454-project Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 072cedf1a6a24f6fa7d7ed92981344dd Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-TestVolumeBootPattern-229576454-project Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 could not be found. Oct 14 18:07:37.330707 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '6ae724fa-9da1-4b63-90be-9f20ce9cec67'} Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 could not be found. Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:07:37.331688 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 could not be found. Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 could not be found. Oct 14 18:07:37.333521 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:37.334993 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Returning 404 to user: Instance 6ae724fa-9da1-4b63-90be-9f20ce9cec67 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:07:37.334993 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-4e68f9dc-59ab-4e5d-8800-c27192a205c1 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67" status: 404 len: 111 microversion: 2.1 time: 0.030817 Oct 14 18:07:37.334993 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 554/1100] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:07:37 2022] GET /compute/v2.1/servers/6ae724fa-9da1-4b63-90be-9f20ce9cec67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:07:40.605170 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-59c38c1d-0e50-45a5-873f-6e5d4a543c29 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:40.605753 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-59c38c1d-0e50-45a5-873f-6e5d4a543c29 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:40.606363 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-9ca5b876-0ac8-4863-bcdb-c2ba11030643 req-eba452f4-5828-4608-8a79-860aec141ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2088de31-2372-410a-8cdf-aa5c6994b8e1", "tag": "0b6dee5f-1229-4749-9587-2fc70c8030a4"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:07:40.612635 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59c38c1d-0e50-45a5-873f-6e5d4a543c29 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:40.613114 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59c38c1d-0e50-45a5-873f-6e5d4a543c29 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:40.613544 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59c38c1d-0e50-45a5-873f-6e5d4a543c29 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:40.614237 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59c38c1d-0e50-45a5-873f-6e5d4a543c29 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:40.614686 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59c38c1d-0e50-45a5-873f-6e5d4a543c29 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:40.615102 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-59c38c1d-0e50-45a5-873f-6e5d4a543c29 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:40.616639 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-9ca5b876-0ac8-4863-bcdb-c2ba11030643 req-eba452f4-5828-4608-8a79-860aec141ef4 service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:40.617535 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-9ca5b876-0ac8-4863-bcdb-c2ba11030643 req-eba452f4-5828-4608-8a79-860aec141ef4 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:40.618024 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-9ca5b876-0ac8-4863-bcdb-c2ba11030643 req-eba452f4-5828-4608-8a79-860aec141ef4 service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:40.630469 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-9ca5b876-0ac8-4863-bcdb-c2ba11030643 req-eba452f4-5828-4608-8a79-860aec141ef4 service nova] Creating event network-changed:0b6dee5f-1229-4749-9587-2fc70c8030a4 for instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 on hv-cinder-74915 Oct 14 18:07:40.636095 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-9ca5b876-0ac8-4863-bcdb-c2ba11030643 req-eba452f4-5828-4608-8a79-860aec141ef4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033460 Oct 14 18:07:40.636687 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 555/1101] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:07:40.642913 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-59c38c1d-0e50-45a5-873f-6e5d4a543c29 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Going to try to terminate instance {{(pid=118656) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 18:07:40.730195 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-59c38c1d-0e50-45a5-873f-6e5d4a543c29 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 204 len: 0 microversion: 2.1 time: 0.129392 Oct 14 18:07:40.732523 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 547/1102] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:07:40 2022] DELETE /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 18:07:40.741905 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-90ec85d7-c719-4aef-a3dd-ffeed4e460b7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:40.742702 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-90ec85d7-c719-4aef-a3dd-ffeed4e460b7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:40.749756 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90ec85d7-c719-4aef-a3dd-ffeed4e460b7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:40.750249 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90ec85d7-c719-4aef-a3dd-ffeed4e460b7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:40.750681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90ec85d7-c719-4aef-a3dd-ffeed4e460b7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:40.751955 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90ec85d7-c719-4aef-a3dd-ffeed4e460b7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:40.752516 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90ec85d7-c719-4aef-a3dd-ffeed4e460b7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:40.753394 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-90ec85d7-c719-4aef-a3dd-ffeed4e460b7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:40.914978 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.policy [None req-90ec85d7-c719-4aef-a3dd-ffeed4e460b7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118655) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:07:40.923582 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-90ec85d7-c719-4aef-a3dd-ffeed4e460b7 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1575 microversion: 2.1 time: 0.187350 Oct 14 18:07:40.924179 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 556/1103] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:07:40 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:07:41.947162 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-2050fbf3-dc33-4537-a676-20c55534df5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:41.947853 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-2050fbf3-dc33-4537-a676-20c55534df5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:41.954751 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2050fbf3-dc33-4537-a676-20c55534df5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:41.955333 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2050fbf3-dc33-4537-a676-20c55534df5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:41.955766 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2050fbf3-dc33-4537-a676-20c55534df5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:41.956512 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2050fbf3-dc33-4537-a676-20c55534df5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:41.956974 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2050fbf3-dc33-4537-a676-20c55534df5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:41.957394 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-2050fbf3-dc33-4537-a676-20c55534df5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:42.115307 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-2050fbf3-dc33-4537-a676-20c55534df5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:07:42.122976 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-2050fbf3-dc33-4537-a676-20c55534df5a tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1575 microversion: 2.1 time: 0.180063 Oct 14 18:07:42.123521 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 548/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:07:41 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:07:42.897617 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [req-e11c66d1-ea92-465b-89b4-b84f55b7eae0 req-026d212d-d14c-4ee2-a7dc-f7f7dde62eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2088de31-2372-410a-8cdf-aa5c6994b8e1", "name": "network-vif-deleted", "tag": "0b6dee5f-1229-4749-9587-2fc70c8030a4"}]} {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 18:07:42.908644 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e11c66d1-ea92-465b-89b4-b84f55b7eae0 req-026d212d-d14c-4ee2-a7dc-f7f7dde62eee service nova] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:42.909122 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e11c66d1-ea92-465b-89b4-b84f55b7eae0 req-026d212d-d14c-4ee2-a7dc-f7f7dde62eee service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:42.909547 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [req-e11c66d1-ea92-465b-89b4-b84f55b7eae0 req-026d212d-d14c-4ee2-a7dc-f7f7dde62eee service nova] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:42.921646 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.compute.server_external_events [req-e11c66d1-ea92-465b-89b4-b84f55b7eae0 req-026d212d-d14c-4ee2-a7dc-f7f7dde62eee service nova] Creating event network-vif-deleted:0b6dee5f-1229-4749-9587-2fc70c8030a4 for instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 on hv-cinder-74915 Oct 14 18:07:42.926681 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [req-e11c66d1-ea92-465b-89b4-b84f55b7eae0 req-026d212d-d14c-4ee2-a7dc-f7f7dde62eee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032808 Oct 14 18:07:42.927269 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 557/1105] 10.222.0.27 () {64 vars in 1317 bytes} [Fri Oct 14 18:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 18:07:43.147290 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:43.147901 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:43.154680 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:43.155165 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:43.155617 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:43.156334 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:43.156869 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:43.157269 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:43.192821 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:43.193310 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:43.193747 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:43.194197 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.objects.instance [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lazy-loading 'fault' on Instance uuid 2088de31-2372-410a-8cdf-aa5c6994b8e1 {{(pid=118656) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 18:07:43.236975 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.policy [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072cedf1a6a24f6fa7d7ed92981344dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b79c338b0047dfb68e9a5b9b16c51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118656) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 18:07:43.245062 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-82bb34d2-2a7b-47d1-9895-22a71bf16d3b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 200 len: 1228 microversion: 2.1 time: 0.101684 Oct 14 18:07:43.245641 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 549/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:07:43 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 1228 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 18:07:44.270343 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:44.271033 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: 2088de31-2372-410a-8cdf-aa5c6994b8e1] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:44.277386 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:44.277861 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:44.278292 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:44.278978 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:44.279428 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:44.279848 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:44.293241 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] HTTP exception thrown: Instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 could not be found. Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Request method failure captured: Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 HTTP/1.1 Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaOZWpQaGp62BSIfkx4qhavceRUH_o-jNYVY8yp9OQSx3hBLFcCHv6IiI0NVNAn9uZnnSYjBB1eaYKelB0GnwtmzwKvipA4KmzlzM3salbGlEXZwLHIHtW-bSAmTkoUfSSZ7509FMKTfbPygcxsZkOpDnAznE4tSoZS4yhhj98XQ-po Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 87b79c338b0047dfb68e9a5b9b16c51b Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:07:44.295085 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87b79c338b0047dfb68e9a5b9b16c51b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 87b79c338b0047dfb68e9a5b9b16c51b Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-TestVolumeBootPattern-229576454-project Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 072cedf1a6a24f6fa7d7ed92981344dd Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-TestVolumeBootPattern-229576454-project Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 could not be found. Oct 14 18:07:44.296840 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': '2088de31-2372-410a-8cdf-aa5c6994b8e1'} Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 could not be found. Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:07:44.297916 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 could not be found. Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 could not be found. Oct 14 18:07:44.299551 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:44.301117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Returning 404 to user: Instance 2088de31-2372-410a-8cdf-aa5c6994b8e1 could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:07:44.301117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-07a30980-4879-4c55-b9c8-d2fe1fe57f65 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1" status: 404 len: 111 microversion: 2.1 time: 0.031505 Oct 14 18:07:44.301117 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 558/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:07:44 2022] GET /compute/v2.1/servers/2088de31-2372-410a-8cdf-aa5c6994b8e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:07:45.006666 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:45.007234 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.compute.api [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118656) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:45.013763 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:45.014246 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:45.014681 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:45.015367 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:45.016039 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:45.016473 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG oslo_concurrency.lockutils [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:45.029364 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.wsgi [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] HTTP exception thrown: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Request method failure captured: Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: request: DELETE /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f HTTP/1.1 Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept: application/json Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Accept-Encoding: identity Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Connection: close Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Length: 0 Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Content-Type: application/json Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Host: 10.222.0.27 Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: Openstack-System-Scope: None Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: User-Agent: python-urllib3/1.26.12 Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Auth-Token: gAAAAABjSaOZWpQaGp62BSIfkx4qhavceRUH_o-jNYVY8yp9OQSx3hBLFcCHv6IiI0NVNAn9uZnnSYjBB1eaYKelB0GnwtmzwKvipA4KmzlzM3salbGlEXZwLHIHtW-bSAmTkoUfSSZ7509FMKTfbPygcxsZkOpDnAznE4tSoZS4yhhj98XQ-po Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Id: None Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Domain-Name: None Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Identity-Status: Confirmed Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Is-Admin-Project: True Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Id: default Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Domain-Name: Default Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Id: 87b79c338b0047dfb68e9a5b9b16c51b Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Project-Name: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Role: member,reader Oct 14 18:07:45.030989 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Roles: member,reader Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87b79c338b0047dfb68e9a5b9b16c51b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Id: 87b79c338b0047dfb68e9a5b9b16c51b Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-Tenant-Name: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User: tempest-TestVolumeBootPattern-229576454-project Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Id: default Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Domain-Name: Default Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Id: 072cedf1a6a24f6fa7d7ed92981344dd Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: X-User-Name: tempest-TestVolumeBootPattern-229576454-project Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: method: > Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: exception: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:07:45.033256 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: action_args: {'id': 'fd2a9478-c81a-49f6-9176-c90b6e15466f'} Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:07:45.034249 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:07:45.035864 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: ERROR nova.api.openstack.wsgi Oct 14 18:07:45.037847 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Returning 404 to user: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. {{(pid=118656) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:07:45.037847 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-fd4fcf5b-6017-4d20-aac0-f558f7e37b53 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 404 len: 111 microversion: 2.1 time: 0.030096 Oct 14 18:07:45.037847 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 550/1108] 10.222.0.27 () {58 vars in 1239 bytes} [Fri Oct 14 18:07:45 2022] DELETE /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:07:45.041422 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '>' {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:45.042022 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.compute.api [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] [instance: fd2a9478-c81a-49f6-9176-c90b6e15466f] Fetching instance by UUID {{(pid=118655) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 18:07:45.048810 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:45.049283 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:45.049711 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:45.050392 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Acquiring lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 18:07:45.050833 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 18:07:45.051251 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG oslo_concurrency.lockutils [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Lock "d3910e64-6c9f-4b06-9301-0c1a6426780a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 18:07:45.064472 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.wsgi [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] HTTP exception thrown: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Request method failure captured: Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: request: GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f HTTP/1.1 Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept: application/json Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Accept-Encoding: identity Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Connection: close Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Length: 0 Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Content-Type: application/json Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Host: 10.222.0.27 Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: Openstack-System-Scope: None Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: User-Agent: python-urllib3/1.26.12 Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Auth-Token: gAAAAABjSaOZWpQaGp62BSIfkx4qhavceRUH_o-jNYVY8yp9OQSx3hBLFcCHv6IiI0NVNAn9uZnnSYjBB1eaYKelB0GnwtmzwKvipA4KmzlzM3salbGlEXZwLHIHtW-bSAmTkoUfSSZ7509FMKTfbPygcxsZkOpDnAznE4tSoZS4yhhj98XQ-po Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Id: None Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Domain-Name: None Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Identity-Status: Confirmed Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Is-Admin-Project: True Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Id: default Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Domain-Name: Default Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Id: 87b79c338b0047dfb68e9a5b9b16c51b Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Project-Name: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Role: member,reader Oct 14 18:07:45.065961 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Roles: member,reader Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_87b79c338b0047dfb68e9a5b9b16c51b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/87b79c338b0047dfb68e9a5b9b16c51b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Id: 87b79c338b0047dfb68e9a5b9b16c51b Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-Tenant-Name: tempest-TestVolumeBootPattern-229576454 Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User: tempest-TestVolumeBootPattern-229576454-project Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Id: default Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Domain-Name: Default Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Id: 072cedf1a6a24f6fa7d7ed92981344dd Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: X-User-Name: tempest-TestVolumeBootPattern-229576454-project Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: method: > Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: exception: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:07:45.067665 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: action_args: {'id': 'fd2a9478-c81a-49f6-9176-c90b6e15466f'} Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: {{(pid=118655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 18:07:45.069477 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. Oct 14 18:07:45.071127 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: ERROR nova.api.openstack.wsgi Oct 14 18:07:45.072616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: DEBUG nova.api.openstack.wsgi [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Returning 404 to user: Instance fd2a9478-c81a-49f6-9176-c90b6e15466f could not be found. {{(pid=118655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 18:07:45.072616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: INFO nova.api.openstack.requestlog [None req-e6149eac-65a1-4c87-b4d0-c07abaa4553b tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f" status: 404 len: 111 microversion: 2.1 time: 0.029743 Oct 14 18:07:45.072616 dv-cinder-749155-15-iscsi devstack@n-api.service[118655]: [pid: 118655|app: 0|req: 559/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Fri Oct 14 18:07:45 2022] GET /compute/v2.1/servers/fd2a9478-c81a-49f6-9176-c90b6e15466f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 18:07:46.358932 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: DEBUG nova.api.openstack.wsgi [None req-7de13254-3611-41ac-8919-ee83afb63d38 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] Calling method '.version_select at 0x7fe3daa7cdc0>' {{(pid=118656) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 18:07:46.383529 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: INFO nova.api.openstack.requestlog [None req-7de13254-3611-41ac-8919-ee83afb63d38 tempest-TestVolumeBootPattern-229576454 tempest-TestVolumeBootPattern-229576454-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-941379814" status: 202 len: 0 microversion: 2.1 time: 0.028384 Oct 14 18:07:46.384159 dv-cinder-749155-15-iscsi devstack@n-api.service[118656]: [pid: 118656|app: 0|req: 551/1110] 10.222.0.27 () {58 vars in 1260 bytes} [Fri Oct 14 18:07:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-941379814 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)